About this position

In lower-resource languages such as Dutch, it can be challenging to find enough high-quality data to train large language models. When data is collected in an ethical manner, without scraping copyrighted material, this creates even more data sparsity. As a result, data from other sources is used and transformed. For example, texts are translated, adapted, shortened and lengthened. These actions are often necessary, but they also raise important concerns about (cultural) representation and bias. They can introduce different norms and values and cause social groups, identities and cultural concepts to be inaccurately represented. This can have negative effects in sensitive contexts such as recruitment, education and public services, where misrepresentation can have real-world consequences.

In this research internship, the central question is: How does the use of translated data affect representation in language models for Dutch?

What will be your role?

During this internship you will set up a research project regarding the effects of translation on representation in LLMs. You will design experiments to investigate these effects. Potential directions include evaluating the effects of different transformations, different models or evaluation methods. Your insights will contribute to informed decisions about ethical training of LLMs within TNO and outside.

What we expect from you

For this internship, we are looking for a highly motivated master’s student with a background in Natural Language Processing, Linguistics, Artificial intelligence, Data Science or a related field.

You have an interest in the societal aspects of AI, in topics such as bias, fairness, and representation. You can work independently and communicate clearly. Ideally, this internship is carried out as part of your Master’s thesis.

What you'll get in return

An internship at TNO means working in an environment where substance and impact are central. You will become part of a knowledge organisation where research and practice come together, and where experts collaborate on solutions to current societal and technological challenges.

Your internship is a period in which you can discover what suits you, where your strengths lie and what you would like to learn next. You are part of a professional working environment, gain insight into how things work in practice, and have the opportunity to build experience that goes beyond this internship alone. For many students, an internship is therefore also a first step in discovering whether TNO could be a potential next step after graduation.

In addition, we offer you: