Science & Technology
Yandex develops test to evaluate AI systems based on moral values
The company Yandex has presented a concept to the Russian government for testing AI systems to assess their compliance with spiritual and moral values as well as legal requirements.
Yandex has presented a national dataset to the Russian government cabinet for evaluating AI systems based on their alignment with spiritual and moral values. According to reports from Habr, the concept includes a set of test tasks and reference answers designed to compare various neural networks.
The test aims to assess the compliance of AI systems with the values of the country and their suitability for the Russian market. This approach was discussed during a meeting of the working group on the regulation and administrative barriers for artificial intelligence on August 13, 2023, according to sources from Meduza and Habr.
An anonymous insider present at the meeting stated that the necessity of the test lies in ensuring that AI systems align with the 'spirit of our time.' It was particularly emphasized that the test should be tailored to the specific requirements of the Russian market.
However, it remains unclear who will be responsible for the content of the tests. Sources suggest forming a joint commission that includes state institutions, companies, and experts to undertake this task.
The Russian Federal Security Service (FSB) has emphasized that the test should have a closed nature, raising questions about transparency and the criteria to be used for evaluating the AI.