Things we learned about LLMs in 2024

In 2024, multiple organisations developed Large Language Models (LLMs) surpassing GPT-4’s capabilities, with some models now operable on personal devices. LLM costs decreased due to competition and efficiency improvements, while context lengths expanded, enabling more comprehensive inputs. Multimodal functionalities, including video and audio processing, became more prevalent, though fully autonomous AI agents remain unrealised. The environmental impact of LLMs showed mixed trends, and the need for improved critical evaluation of these models persists.

Visit Original Article →