Online, 30/01/2025.
iToBoS partners held a joint workshop with the NEMECYS project to share information about project results (specifically the AI Privacy Risk Assessment tool) and gather feedback from relevant stakeholders from the health domain.
The AI Privacy Risk Assessment (AIRA) tool is an end-to-end framework for privacy risk assessment of AI models. It aims to alleviate the issues of existing tools and frameworks that require a high degree of expertise or are tightly coupled with specific ML frameworks.
The first goal of this end-to-end risk assessment tool is to automate many of the decisions around which attacks and metrics to run, and all of the technical preparation required in order to run them. Secondly, since most non-technical users cannot understand the meaning of each individual attack or score, the tool summarizes these individual results into an overall privacy risk score.
The tool enables assessing models from different ML frameworks, using a variety of low-level privacy attacks and metrics, without requiring deep technical expertise.
It was a very fruitful discussion and we got a lot of good questions and observations from the participants. We hope to further improve our tool based on the feedback and look forward to more collaborations between the projects.
Find out more about NEMECYS project.