April 16, 2024

Generating Responsibility: Assessing AI Using AI

How Do Generative AI Models Score on the VIOLET Impact Model™?

With the rapid development and adoption of generative AI in various industries, there is a need for organizations to better understand both the business value and associated risks of these technologies. Recognizing this, prominent researchers (Bommasani et al., 2023a; 2023b) have attempted to quantify and assess components of generative AI models to determine whether they align with measurable standards of responsible AI. While beneficial, the criteria in these studies are arguably too narrow in scope to produce meaningful recommended action plans for users or developers at a comprehensive level, or ensure that systems are responsible from a global standpoint. To fully harness AI in a responsible manner, a broad approach accompanied by a scientific method of measuring AI systems at scale is needed. In response to these clear needs, and as a complimentary effort to prior research efforts, Vero AI™ developed the VIOLET Impact Model™. The central aims of this paper were to take an exploratory approach to testing 10 popular generative AI models, quantify the responsible use of popular generative AI model documentation, and demonstrate the utility of taking Vero AI’s VIOLET Impact Model as an approach to measuring responsible AI system effort within these rapidly developing and intricate technologies. No single generative AI model achieved a perfect score. We found that, on average, most of the models we evaluated did well providing documentation pertaining to model Effectiveness. However, there was room for improvement regarding their documentation pertaining to Optimization. More specific scores on VIOLET Components and Themes are shown in the report. In sum, in our evaluation of the generative AI models using the VIOLET Impact Model demonstrated utility by pinpointing valuable strategic insights into the responsibility of these systems.

Cofounder and CEO

Eric Sydell, PhD

The VIOLET Impact ModelTM

Vero AI' work centers on the VIOLET Impact ModelTM, a holistic framework that provides a comprehensive and objective view of the impact of algorithms and complex systems.


The degree to which affected individuals are aware of how algorithms are being used.


Whether the algorithm does good and whether it is fair to all classes.


How well the algorithm was built.

Legislative Preparedness

How well the algorithm and surrounding systems are prepared to meet the requirements of current and upcoming legislation.


How well the algorithm works.


How clearly understood the algorithm and its uses are internally.

Contact us for a free consultation

Contact us for a free consultation

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.