Montevive

/ Blog /

News

Montevive

ALIA: We test the new AI model from the Government of Spain.

·admin·Artificial Intelligence
ALIA: We test the new AI model from the Government of Spain.

https://www.youtube.com/embed/wUV1ozk6AvA?feature=oembed

The field of Artificial Intelligence in Spain has taken a significant step with the launch of ALIA. In this article, we analyze this new model and share the results of our practical test.

🧠 What is ALIA?

ALIA (Assets for Language and Artificial Intelligence) is a project developed by the Government of Spain. Its main component is a language model (LLM) with 40 billion parameters, designed to compete with cutting-edge international models.

🌟 Main Features

  • 40B parameter model
  • Multilingual capability: Spanish, Catalan, Basque, Galician, and other languages
  • Open source: code and training scripts publicly available
  • Accessible datasets for research and development

🧪 Our Test

To test ALIA a bit, we conducted a test in a local environment with the following specifications:

  1. Hardware: 2x NVIDIA RTX 3090 Ti
  2. Software: llama.cpp with a model quantized to 3 bits

The challenge was to complete the phrase "Once upon a time" with up to 100 tokens in five languages: Spanish, Catalan, Basque, Galician, and English.

📊 Results

Highlights:

  1. Narrative consistency in the generated stories
  2. Use of varied vocabulary and complex syntactic structures... except in the case of Basque, which repeated the same thing: "among us Basques there is no willingness to learn Basque, and even less to live in Basque". Who knows where they got that text for training.
  3. Adaptation to cultural references specific to each language.
  4. Pattern without accents. If you look at the video, the Spanish input was "Erase una vez", without an accent on the E. Result? In the generated text, it didn't put a single accent... bug or feature?

🚀 Implications for AI in Spain

The launch of ALIA represents a significant advance in the development of AI in Spain. Its open-source nature could catalyze innovation in various sectors, from education to industry and public administration.

🎬 Conclusion

ALIA demonstrates Spain's potential in the field of AI. Despite being a model of only 40B, it is a starting point, especially for applications requiring a deep understanding of the languages and cultures of Spain.

We will continue to closely follow ALIA's development and conduct more tests in the future. We are interested in your opinion:

What applications would you like to see developed with ALIA?