1

Reducing Cultural Hallucination in Non-English

Languages Via Prompt Engineering for Large
Language Models
Kanato Sato , Haruto Kaneko, Mei Fujimura

Abstract—Advancements in prompt engineering offer signif- scarcity of practical solutions accentuate the urgent need for
icant potential for mitigating cultural hallucinations in large targeted methodologies that address the unique challenges of
language models (LLMs). The strategic formulation of prompts, cultural representation in automated systems, aiming to curb
when combined with deep cultural and linguistic insights, en-
hances the accuracy and cultural sensitivity of LLMs, particu- the inadvertent perpetuation of cultural stereotypes and ensure
larly in non-English contexts. This paper explores the application the creation of culturally sensitive AI outputs.
of prompt engineering across three major LLMs—OpenAI Chat- The primary aim of this article is to deepen the understand-
GPT, Google Gemini, and Anthropic Claude—demonstrating ing of cultural hallucination in non-English language models
how tailored prompts can effectively reduce cultural biases and and to delineate a comprehensive framework for prompt engi-
improve user interaction. Through case studies and comparative
analysis, the research identifies best practices and provides neering designed to minimize such inaccuracies. By exploring
strategic recommendations for further development. The findings the underlying mechanisms through which cultural biases
emphasize the importance of continuous innovation and ethical manifest in the outputs of LLMs, and rigorously evaluating the
considerations in AI to ensure inclusivity and respect for cultural efficacy of diverse prompt engineering techniques, this work
diversity in global technology applications. intends to furnish actionable insights that can guide developers
Index Terms—Prompt Engineering, Cultural Sensitivity, Large in the crafting of more culturally attuned AI systems. The
Language Models, Multilingual AI, Ethical AI scope of this investigation encompasses a thorough com-
parative analysis of industry-leading LLMs—namely OpenAI
I. I NTRODUCTION ChatGPT, Google Gemini, and Anthropic Claude—with the
objective of identifying, illustrating, and advocating for effec-
Cultural hallucination by large language models (LLMs)
tive strategies that mitigate cultural hallucinations. This en-
represents an alarming barrier to the effective deployment
deavor is anticipated to contribute significantly to the broader
and equitable impact of artificial intelligence technologies
efforts aimed at promoting inclusivity, equity, and fairness
across globally diverse linguistic and cultural landscapes [1]–
within the realm of artificial intelligence technologies.
[6]. When prominent LLMs like OpenAI ChatGPT, Google
This work makes the following major contributions:
Gemini, and Anthropic Claude generate outputs that exhibit
• We provided a comprehensive framework for prompt
erroneous cultural references or inappropriate assumptions and
stereotypes, the ramifications can undermine the foundational engineering aimed at minimizing cultural inaccuracies in
trust in AI systems, exacerbate existing cultural biases, and non-English language models. This framework leverages
potentiate social discussion [7]–[9]. Moreover, the dispro- detailed analyses of industry-leading LLMs—OpenAI
portionate influence of data sourced from English-speaking ChatGPT, Google Gemini, and Anthropic Claude—to
regions in training those models not only imposes an Anglo- demonstrate effective strategies for enhancing cultural
phone worldview, but often results in outputs that are starkly sensitivity.
• Through a series of case studies, we illustrated the practi-
incongruent with the values, norms, and factual realities of
non-English speaking communities, thereby perpetuating a cal application of tailored prompt engineering techniques
cycle of cultural misrepresentation and dominance [10], [11]. and their impact on reducing cultural hallucinations,
While a substantial corpus of research has focused on iden- thereby significantly improving the cultural competence
tifying and mitigating biases in AI, the specific phenomenon and global applicability of LLMs.
of cultural hallucination, particularly within non-English con- II. BACKGROUND
texts, has not received adequate scholarly attention. Existing
This section provides a comprehensive literature review
literature predominantly concentrates on detecting linguistic
structured into three subsections, each discussing key aspects
biases or enhancing the generalizability of models across
of ethical considerations in AI development, cultural represen-
various languages [12]. However, the complex exploration
tation and bias in AI systems, and challenges in multilingual
of how different cultural contexts significantly influence AI
NLP.
behavior, and the subsequent development of tailored strategies
to minimize culturally inappropriate outputs, remain critically A. Ethical Considerations and Frameworks in AI Development
underexplored [4], [5], [13]. This gap in research and the
The importance of ethical considerations in the development
Corresponding author: Kanato Sato, sato kanato [email protected] of AI systems, particularly those addressing cultural sensi-
 2

tivity, was prominently acknowledged [11], [12], [14]–[18]. [56]–[58]. Moreover, the introduction of cultural awareness in
Ethical frameworks aimed at guiding AI development to con- AI systems was seen as a critical step towards enhancing the
sider cultural diversity were found to be crucial in minimizing global applicability and fairness of those technologies [58].
cultural hallucinations, as they could influence the design and Efforts to quantify cultural bias through metrics were also
operation of AI systems positively, ensuring that they operate found to contribute positively to the development of more
within the bounds of cultural respect and understanding [19]– balanced AI systems, and the application of those metrics in
[21]. Moreover, the neglect of such considerations was seen ongoing monitoring was suggested as an effective approach to
to exacerbate social inequalities and reinforce harmful stereo- maintaining cultural neutrality in AI outputs [4].
types, leading to broader social repercussions [22]–[24]. The
adoption of those ethical guidelines was suggested as essential III. P ROMPT E NGINEERING AS A M ITIGATION S TRATEGY
for fostering an environment of inclusivity and fairness within
This section covers the methodology of using prompt en-
the AI community [22]. It was also noted that such ethical
gineering as a strategy to mitigate cultural hallucinations in
practices contribute to the sustainability of AI technologies,
LLMs.
promoting their acceptance and integration across different
cultural settings worldwide [7], [20], [25], [26]. The proactive
inclusion of diverse cultural perspectives in the initial stages A. Principles of Prompt Engineering
of AI development was highlighted as a strategy that could Prompt engineering has emerged as a powerful technique
fundamentally alter the cultural accuracy of AI systems [27]– to direct and control the behavior of large language models,
[31]. effectively reducing bias and errors in their outputs. Funda-
mental to prompt engineering is the strategic formulation of
B. Challenges in Multilingual Natural Language Processing input queries that guide the model’s focus, framing responses
(NLP) in a manner that aligns more closely with desired accuracy and
The development of multilingual NLP systems was found cultural appropriateness. By carefully constructing prompts,
to encounter numerous challenges, especially concerning the it is possible to significantly influence the content generated
accurate understanding and generation of language across by AI systems, steering them away from biased or culturally
different linguistic frameworks [17], [32]–[36]. The complex- insensitive outputs.
ity of processing and responding in multiple languages was The art of crafting such prompts involves a deep under-
compounded by the need for cultural relevance in interactions, standing of the model’s mechanics and the biases inherent in
which often required AI systems to navigate subtle cultural its training data. Below, the table I summarizes the main prin-
nuances accurately [37]–[40]. Issues in translation and sen- ciples of prompt engineering, offering concise justifications
timent analysis were frequently highlighted, where errors in and illustrative examples for each principle:
capturing the true intent of the user were observed to impact Techniques such as the inclusion of explicit instructions in
the effectiveness of communication significantly [39], [41]– the prompt, or the use of templates that encapsulate desired
[43]. Strategies such as cross-lingual transfer learning and the behaviors, have been found to promote the generation of re-
development of language-agnostic embeddings were found to sponses that are both relevant and sensitive to diverse cultural
alleviate some of those challenges [44]–[46]. Improvements in contexts. Moreover, the iterative refinement of prompts based
the ability of AI to handle multiple languages simultaneously on feedback loops is an essential principle in this area, ensur-
were noted when such strategies were applied, suggesting ing continuous improvement in model performance. Through
their potential utility in enhancing the linguistic flexibility those methods, prompt engineering not only enhances the
and accuracy of AI systems [47], [48]. Additionally, the reliability of AI responses but also extends their applicability
incorporation of cultural context into the training processes across a broader spectrum of linguistic and cultural scenarios.
was seen as beneficial in reducing the occurrence of culturally
insensitive responses [49], [50]. B. Proposed Steps for Prompt Engineering
To effectively reduce cultural hallucinations in non-English
C. Cultural Representation and Bias in AI Systems language models, a systematic approach to prompt engineering
Automated systems, including LLMs, often reflect the cul- is essential. Our methodology involves a series of structured
tural biases inherent in their training data [12], [22], [51], steps, each designed to refine the prompt in a way that
[52]. Particularly, biases toward Western perspectives have enhances its cultural appropriateness and linguistic accuracy.
been shown to dominate, which skews the AI’s understanding Each of those steps involves critical consideration of the
and response mechanisms in ways that do not align with elements within the prompt that could influence the model’s
the cultural contexts of other regions [53], [53], [54]. The output. By systematically applying those steps, prompt engi-
misrepresentation of cultural elements in outputs was found to neering can be effectively used to tailor AI behavior in a way
significantly diminish the trust and usability of AI technologies that respects and understands diverse cultural backgrounds,
in non-Western societies [19], [55]. In response, several miti- thereby reducing the likelihood of cultural hallucinations in
gation strategies were developed, which included diversifying AI-generated content.
the data sources and implementing algorithmic adjustments The following steps are enumerated below to provide a clear
aimed at reducing the prevalence of culturally biased data guide for implementing prompt engineering:
 3

TABLE I: Principles of Prompt Engineering with Justifications and Examples

Principle Justification Example
Explicit Instructions Directly guides the model to generate outputs within “Translate the text considering UK cul-
specific cultural or ethical boundaries, reducing am- tural context.”
biguity and enhancing appropriateness.
Template Usage Structures responses to maintain consistency and “Respond as a customer support agent
relevance, ensuring that outputs adhere to desired from [Country], addressing a complaint.”
formats and standards.
Iterative Refinement Uses feedback loops to continuously improve the Adjusting a prompt based on user feed-
accuracy and cultural sensitivity of prompts and back to better suit regional linguistic nu-
responses, adapting to new insights and corrections. ances.

1) I NITIAL P ROMPT F ORMULATION (Pi ): Start by crafting are converted from one language to another, potentially dis-
an initial prompt that directly addresses the desired torting the intended meaning and leading to erroneous or
task, considering general cultural elements. The prompt biased responses. Furthermore, the cultural context embedded
should be clear and free of ambiguous language to avoid in language use—such as idioms, metaphors, and cultural
unintended model biases. references—necessitates an enhanced understanding of local
2) C ONTEXTUAL L AYERING (CL ): Add layers of cultural customs and values, which must be carefully integrated into
context (C) to the initial prompt, ensuring that it aligns prompt engineering practices to ensure that AI responses are
with the specific cultural norms and values of the not only linguistically accurate but also culturally congruent.
target audience. This might involve including regional
expressions or culturally relevant examples. IV. C ASE S TUDIES
3) S EMANTIC R EFINEMENT (SR ): Refine the prompt se-
mantically to enhance clarity and cultural sensitivity. This section elaborates on how prompt engineering tech-
This involves adjusting terms and phrases to better niques have been applied to reduce cultural hallucination in
reflect the nuances of the target language and culture. three major AI models: OpenAI ChatGPT, Google Gemini,
4) F EEDBACK I NCORPORATION (F ): Integrate feedback and Anthropic Claude.
from preliminary responses. Use insights gained from
the model’s outputs to refine the prompt further, making A. OpenAI ChatGPT
adjustments that target specific errors or cultural inac-
curacies. In the application of prompt engineering to OpenAI Chat-
5) F INAL P ROMPT O PTIMIZATION (Pf ): Optimize the re- GPT, a variety of techniques have been implemented to ef-
fined prompt (Pr ) to produce the final version. Ensure fectively reduce cultural hallucinations. One primary approach
that the prompt is precise, culturally appropriate, and involves the strategic integration of culturally neutral prompts,
designed to elicit the most accurate and contextually specifically designed to minimize the inclusion of culturally
relevant response from the model. biased assumptions. For example, instead of using prompts
that might assume a particular cultural norm, prompts such
as ”Describe a traditional wedding ceremony, considering
C. Challenges in Non-English Prompt Engineering various cultural perspectives” were introduced. Such adjust-
Engineering prompts for non-English languages presents a ments were observed to lead to a significant reduction in
unique set of challenges that complicate the task of minimizing the generation of culturally inappropriate responses, thereby
cultural hallucinations in AI systems. Below, the table II enhancing the global applicability of ChatGPT.
summarizes the main challenges encountered, the reasons Additionally, feedback loops were established, allowing the
those challenges arise, and brief advice on how to mitigate model to learn from its outputs and incrementally improve its
them: responses over time. Another pivotal method employed was
The primary difficulties encountered include the limited the adaptation of prompts to include explicit cultural contexts.
availability of robust datasets in languages other than En- An example of this approach is the prompt modification from
glish, which restricts the ability of models to learn from ”Explain the significance of Thanksgiving” to ”Explain the
a diverse linguistic and cultural background. Additionally, significance of Thanksgiving in American culture and compare
the structural and contextual complexities of languages vary it with harvest festivals in other cultures”. This required the
greatly, requiring tailored approaches in prompt design to model to process and respond with a heightened awareness of
ensure the correct interpretation and response by the AI. cultural sensitivity.
The nuances of grammar, syntax, and usage in non-English The effectiveness of those strategies was corroborated by
languages often demand a higher degree of specificity in improved user satisfaction from diverse cultural backgrounds,
prompt construction to avoid misinterpretations that could indicating successful mitigation of cultural biases. The follow-
lead to culturally inappropriate outputs. Another significant ing figure illustrates the differences in metrics, before and after
challenge is the potential for translation errors when prompts the implementation of prompt engineering techniques:
 4

TABLE II: Challenges of Non-English Prompt Engineering with Causes and Mitigation Strategies
Challenge Reason for Challenge Mitigation Advice
Limited Datasets The scarcity of robust, diverse datasets in non- Seek or create more comprehensive and diverse
English languages restricts the model’s learning datasets that reflect a wider range of linguistic
potential. and cultural backgrounds.
Structural Com- The vast differences in grammar, syntax, and Develop localized prompt design strategies that
plexity context across languages require highly tailored consider specific linguistic and structural features
prompts. of the target language.
Translation Automatic translation can distort the intended Utilize native speakers for translations and cross-
Errors meaning of prompts, leading to inaccuracies. verification to ensure accuracy and cultural rele-
vance.
Cultural Language use often involves idioms, metaphors, Integrate local cultural experts in the prompt
Subtleties and references deeply rooted in specific cultures. design process to ensure cultural congruency and
appropriateness.

100 100
After Prompt Engineering After Prompt Engineering
Before Prompt Engineering Before Prompt Engineering
Cultural Sensitivity Index

Cultural Relevance Index

90 90

80 80

70 70

60 60

50 50
0 2 4 6 8 10 12 0 2 4 6 8 10 12
Time (Iterations) Time (Iterations)
Fig. 1: Comparative Analysis For ChatGPT-4 Fig. 2: Comparative Analysis For Google Gemini

These graphical results highlight the marked improvements

in cultural sensitivity following the implementation of struc-
advanced semantic analysis techniques. A notable example
tured prompt engineering techniques, demonstrating the effi-
includes modifying a general prompt like ”Discuss the im-
cacy of such interventions in enhancing the cultural compe-
portance of tea” to ”Discuss the cultural significance of tea
tence of AI systems.
in British society and compare it with its role in Chinese social
life”, which acknowledges the diverse cultural connotations of
B. Google Gemini tea in different societies.
For Google Gemini, prompt engineering has been metic-
These improvements have led to a significant reduction
ulously tailored to address specific linguistic features and
in cultural hallucinations, as evidenced by the model’s per-
cultural nuances associated with various languages. The intro-
formance in scenarios involving complex cultural content.
duction of context-aware prompts that adapt to the linguistic
Additionally, the continuous updating of the model’s training
structure and cultural context of the user’s language has
dataset with culturally diverse examples has further strength-
substantially improved the cultural accuracy of responses. For
ened its ability to generate culturally appropriate and relevant
instance, a prompt initially designed as ”Describe the celebra-
responses. The following figure illustrates the differences
tion of New Year” was refined to ”Describe the celebration
in metrics, before and after the implementation of prompt
of New Year’s Eve in Spain, focusing on local traditions
engineering techniques:
and foods”, thereby tailoring the response to reflect specific
cultural details. The depicted results clearly demonstrate the marked im-
Moreover, Google Gemini’s capability to handle idiomatic provements in cultural relevance following the application of
expressions and local metaphors was significantly enhanced targeted prompt engineering techniques, thereby underscoring
through the development of a sophisticated understanding the efficacy of such interventions in enhancing the cultural
of regional linguistic idiosyncrasies. This was facilitated by competence of AI systems.
 5

C. Anthropic Claude 100

Anthropic Claude has utilized prompt engineering to priori- After Prompt Engineering
tize ethical considerations and cultural respect within its oper- Before Prompt Engineering

Cultural Sensitivity Score

90
ational framework. By embedding ethical guidelines directly
into the prompt design process, Claude has been enabled to
generate responses that are not only linguistically accurate but 80
also culturally respectful. The application of

D. Anthropic Claude 70
Anthropic Claude has utilized prompt engineering to priori-
tize ethical considerations and cultural respect within its oper- 60
ational framework. By embedding ethical guidelines directly
into the prompt design process, Claude has been enabled to
generate responses that are not only linguistically accurate but 50
0 2 4 6 8 10 12
also culturally respectful. For instance, a generic prompt such
as ”Describe a wedding” was refined to ”Describe a wedding Time (Iterations)
ceremony, taking into account different cultural practices, such Fig. 3: Comparative Analysis For Anthropic Claude
as Hindu, Muslim, Christian, and secular traditions”, which
allows the model to address a broad spectrum of cultural
backgrounds respectfully. Claude reveals distinct approaches and outcomes in mitigating
The application of those ethical prompts has resulted in a cultural hallucinations within large language models. A com-
marked improvement in the model’s ability to engage with parative analysis of those strategies underscores the variability
users from various cultural backgrounds without perpetuating in methodology and the degree to which each model has
stereotypes or cultural biases. Another example includes ad- successfully integrated cultural sensitivity into its operational
justing the prompt from ”Discuss family roles” to ”Discuss framework.
family roles in various cultures, including matrilineal, patri-
In the case of OpenAI ChatGPT, the focus has predom-
lineal, and dual-heritage systems, highlighting the diversity of
inantly been on crafting culturally neutral prompts and in-
familial structures worldwide”. The strategic use of culturally
corporating explicit cultural contexts within prompts. This
informed prompts, combined with ongoing revisions based on
approach has facilitated significant improvements in cultural
user feedback, has effectively enhanced Claude’s sensitivity to
sensitivity, evidenced by the reduction in culturally inappro-
cultural nuances, ensuring that its interactions remain appro-
priate responses and increased satisfaction among users from
priate and respectful across different cultural settings.
diverse backgrounds. The specific technique of embedding
The success of those measures in reducing cultural hallu-
cultural contexts directly into the prompts has been particularly
cinations has been widely recognized, further establishing the
effective, as demonstrated by the enhanced ability of ChatGPT
importance of ethical prompt engineering in the development
to handle culturally complex queries.
of responsible AI technologies. The following figure illustrates
the differences in metrics, before and after the implementation Google Gemini, on the other hand, has emphasized the
of prompt engineering techniques: adaptation of its prompts to the structural and idiomatic pecu-
The depicted results clearly demonstrate the marked im- liarities of different languages, thereby improving the cultural
provements in cultural sensitivity following the application accuracy of its responses. This model has excelled in handling
of targeted prompt engineering techniques, underscoring the idiomatic expressions and cultural metaphors, which has been
efficacy of such interventions in enhancing the cultural com- pivotal in reducing cultural hallucinations. The continuous
petence of AI systems. The ethical prompts has resulted in enrichment of its training dataset with culturally diverse ex-
a marked improvement in the model’s ability to engage with amples has further enabled Gemini to refine its responses over
users from various cultural backgrounds without perpetuating time, showcasing a dynamic approach to cultural competence.
stereotypes or cultural biases. The strategic use of culturally Anthropic Claude has integrated ethical considerations di-
informed prompts, combined with ongoing revisions based on rectly into its prompt engineering process, ensuring that all
user feedback, has effectively enhanced Claude’s sensitivity to generated responses adhere to high standards of cultural re-
cultural nuances, ensuring that its interactions remain appro- spect and sensitivity. This model has distinguished itself by
priate and respectful across different cultural settings. The suc- not only focusing on linguistic accuracy but also on ethical
cess of those measures in reducing cultural hallucinations has responsiveness, which has significantly enhanced its interac-
been widely recognized, further establishing the importance of tions across various cultural settings. The use of culturally
ethical prompt engineering in the development of responsible informed prompts and the ongoing revisions based on user
AI technologies. feedback have made Claude a leader in ethical AI interactions.
The comparative analysis reveals that while all three models
V. C OMPARATIVE A NALYSIS have made commendable strides in their respective areas, the
The effectiveness of prompt engineering strategies em- integration of ethical guidelines in prompt engineering, as
ployed by OpenAI ChatGPT, Google Gemini, and Anthropic seen with Anthropic Claude, offers a substantial advantage
 6

in fostering responsible AI technologies. This approach not experts, and ethicists can foster the development of more
only addresses the immediate inaccuracies but also ingrains holistic and culturally competent AI systems. Such inter-
a deeper level of cultural and ethical mindfulness into the disciplinary approaches would combine technical exper-
AI, setting a benchmark for future developments in the tise with deep cultural and ethical insights, enriching the
field. Overall, the strategies implemented by those models development process.
demonstrate a robust framework for reducing cultural biases Future research should also explore the longitudinal effects
and enhancing the global applicability of AI technologies. of prompt engineering on user satisfaction and system per-
However, the continuous evolution of those strategies will be formance in diverse cultural settings. Investigating the long-
crucial in maintaining their effectiveness as the linguistic and term impacts of culturally tailored prompt engineering can
cultural landscapes of AI users continue to diversify. provide deeper insights into the sustainability and effectiveness
of those strategies over time. Additionally, comparative studies
VI. R ECOMMENDATIONS AND F UTURE W ORK
on the performance of culture-specific models versus general
The exploration of prompt engineering as a strategy for models can elucidate the benefits and potential trade-offs of
mitigating cultural hallucinations in large language models specialized versus generalized AI systems. While significant
has yielded significant insights. Yet, the potential for further progress has been made, the journey towards fully culturally
enhancement and adaptation remains vast. Based on the find- competent AI systems is ongoing. The recommendations and
ings presented in this study, several strategic recommendations potential research areas outlined above serve as a roadmap for
for developers and researchers are proposed to advance the future efforts aimed at enhancing the cultural sensitivity and
efficacy and applicability of large language models in multicul- overall effectiveness of large language models.
tural and multilingual contexts. Additionally, promising areas
for future research are highlighted to encourage continuous
improvement and innovation in this field. VII. C ONCLUSION
• Expand Data Diversity: Developers should focus on The investigations conducted and methodologies applied
expanding the diversity of datasets used in training large throughout this study have illuminated the significant impact
language models. Efforts should be directed toward the of prompt engineering on mitigating cultural hallucinations in
collection and incorporation of data from underrepre- large language models (LLMs). It is evident that the strategic
sented languages and cultures to enhance the models’ un- manipulation of prompts, when infused with cultural and
derstanding and responsiveness to a broader demographic linguistic insights, leads to enhanced performance of LLMs
spectrum. across diverse cultural contexts. The integration of culturally
• Enhance Semantic Analysis Capabilities: Enhancing informed prompts not only improves the accuracy and rele-
the models’ capabilities to perform advanced semantic vance of model responses but also ensures that responses are
analysis is crucial. Such advancements would allow for a delivered with a high degree of cultural sensitivity, thereby
deeper understanding of context, idiomatic expressions, addressing one of the major challenges faced by LLMs in
and cultural nuances, thereby improving the accuracy non-English languages. The case studies of OpenAI ChatGPT,
and appropriateness of responses across different cultural Google Gemini, and Anthropic Claude have demonstrated
contexts. the practical applicability and effectiveness of prompt en-
• Develop Culture-specific Models: The development of gineering in real-world scenarios. Each model, through its
specialized models tailored to specific cultural or linguis- unique approach to prompt engineering, has shown that tai-
tic groups could provide more accurate and culturally lored prompts significantly reduce the likelihood of cultural
relevant responses. Such models would leverage localized bias and enhance the user experience for individuals from
data and insights to address the unique challenges and varied cultural backgrounds. The success of those strategies
requirements of particular cultural groups. underscores the necessity for continuous innovation in the
• Implement Continuous Learning Loops: Integrating field of AI, particularly in the development of techniques
continuous learning loops within the operational frame- that respect and reflect the cultural diversity of global users.
work of language models can significantly enhance their Moreover, the comparative analysis conducted within this
adaptability. By continuously learning from user interac- research highlights the varied effectiveness of different prompt
tions and feedback, models can dynamically update their engineering strategies and offers valuable insights into how
knowledge bases and response strategies to better align those strategies can be optimized for better performance. It is
with evolving cultural and linguistic norms. clear from the analysis that while all models have made strides
• Focus on Ethical AI Development: There should be an in addressing cultural hallucinations, the continuous evolution
increased focus on the ethical aspects of AI development. of those strategies is essential to keep pace with the rapidly
Establishing clear ethical guidelines and integrating them changing global linguistic landscape.
into the development and operational processes of AI The recommendations provided herein advocate for a mul-
systems is essential to ensure that those technologies are tifaceted approach to future developments in AI, emphasiz-
not only efficient but also fair and respectful of cultural ing the importance of diverse data sets, enhanced semantic
diversity. analysis, and the development of culturally specific mod-
• Interdisciplinary Collaboration: Encouraging collabo- els. Furthermore, the emphasis on ethical AI development
ration between AI developers, linguists, cultural studies and interdisciplinary collaboration is critical to achieving AI
 7

systems that are not only effective but also equitable and [22] E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell, “On
culturally competent. The findings from this study advocate the dangers of stochastic parrots: Can language models be too big?” in
Proceedings of the 2021 ACM conference on fairness, accountability,
for a more nuanced understanding of cultural dynamics in and transparency, 2021, pp. 610–623.
AI interactions and highlight the transformative potential of [23] R. Baguma, “Check for examining potential harms of large language
prompt engineering in crafting AI responses that are both models (llms) in africa,” in Safe, Secure, Ethical, Responsible Technolo-
gies and Emerging Applications: First EAI International Conference,
linguistically accurate and culturally appropriate. The ongoing SAFER-TEA 2023, Yaoundé, Cameroon, October 25–27, 2023, Proceed-
commitment to enhancing the cultural competence of LLMs ings. Springer Nature, 2024, p. 3.
will undoubtedly contribute to more inclusive and accessible [24] A. Zhou, “Queer bias in natural language processing: Towards more
expansive frameworks of gender and sexuality in nlp bias research,”
AI technologies, paving the way for a future where AI supports 2024.
and enhances human interaction across all cultural divides. [25] R. Bommasani, D. A. Hudson, E. Adeli, R. Altman, S. Arora, S. von
Arx, M. S. Bernstein, J. Bohg, A. Bosselut, E. Brunskill et al.,
R EFERENCES “On the opportunities and risks of foundation models,” arXiv preprint
arXiv:2108.07258, 2021.
[1] A. Gunjal, J. Yin, and E. Bas, “Detecting and preventing hallucinations [26] M. Jakesch, Assessing the Effects and Risks of Large Language Models
in large vision language models,” in Proceedings of the AAAI Conference in AI-Mediated Communication. Cornell University, 2022.
on Artificial Intelligence, vol. 38, no. 16, 2024, pp. 18 135–18 143. [27] M.-Y. Chan and S.-M. Wong, “A comparative analysis to evaluate bias
[2] X. Guan, Y. Liu, H. Lin, Y. Lu, B. He, X. Han, and L. Sun, “Mitigating and fairness across large language models with benchmarks,” 2024.
large language model hallucinations via autonomous knowledge graph- [28] S. Haugen, “Language model ai and international commercial arbitra-
based retrofitting,” in Proceedings of the AAAI Conference on Artificial tion,” Master’s thesis, uis, 2023.
Intelligence, vol. 38, no. 16, 2024, pp. 18 126–18 134. [29] R. Ishizaki and M. Sugiyama, “Large language models: Assessment for
[3] J. Li, X. Cheng, W. X. Zhao, J.-Y. Nie, and J.-R. Wen, “Halueval: singularity,” 2024.
A large-scale hallucination evaluation benchmark for large language [30] D. C. Cavalcante, “Beyond consciousness in large language models:
models,” in Proceedings of the 2023 Conference on Empirical Methods An investigation into the existence of a” soul” in self-aware artificial
in Natural Language Processing, 2023, pp. 6449–6464. intelligences,” 2024.
[4] R. Navigli, S. Conia, and B. Ross, “Biases in large language models: ori- [31] A. R. Arguedas and F. M. Simon, “Automating democracy: Generative
gins, inventory, and discussion,” ACM Journal of Data and Information ai, journalism, and the future of democracy,” 2023.
Quality, vol. 15, no. 2, pp. 1–21, 2023. [32] V. Ravishankar, “Understanding multilingual language models: Training,
[5] T. R. McIntosh, T. Liu, T. Susnjak, P. Watters, A. Ng, and M. N. Halga- representation and architecture,” 2023.
muge, “A culturally sensitive test to evaluate nuanced gpt hallucination,” [33] N. Karanikolas, E. Manga, N. Samaridi, E. Tousidou, and M. Vassi-
IEEE Transactions on Artificial Intelligence, 2023. lakopoulos, “Large language models versus natural language understand-
[6] S. Sadiq, “Generative ai: Language models and multimodal foundation ing and generation,” in Proceedings of the 27th Pan-Hellenic Conference
models,” 2023. on Progress in Computing and Informatics, 2023, pp. 278–290.
[7] K.-J. Tokayev, “Ethical implications of large language models a multi- [34] S. M. Wong, H. Leung, and K. Y. Wong, “Efficiency in language
dimensional exploration of societal, economic, and technical concerns,” understanding and generation: An evaluation of four open-source large
International Journal of Social Analytics, vol. 8, no. 9, pp. 17–33, 2023. language models,” 2024.
[8] A. Pérez y Madrid and C. Wright, “Trustworthy ai alone is not enough,” [35] S. Pan, L. Luo, Y. Wang, C. Chen, J. Wang, and X. Wu, “Unifying
2023. large language models and knowledge graphs: A roadmap,” IEEE
[9] T. Duke, “Building responsible ai algorithms,” 2023. Transactions on Knowledge and Data Engineering, 2024.
[10] S. Gururangan, “Data-centric methods for decentralizing large language [36] S. Wang, Q. Ouyang, and B. Wang, “Comparative evaluation of com-
models,” Ph.D. dissertation, 2024. mercial large language models on promptbench: An english and chinese
[11] J. Okerlund, E. Klasky, A. Middha, S. Kim, H. Rosenfeld, M. Kleinman, perspective,” 2024.
and S. Parthasarathy, “What’s in the chatterbox? large language models, [37] C. Ziems, W. Held, O. Shaikh, J. Chen, Z. Zhang, and D. Yang,
why they matter, and what we should do about them,” Tech. Rep., 2022. “Can large language models transform computational social science?”
[12] Y. Chang, X. Wang, J. Wang, Y. Wu, L. Yang, K. Zhu, H. Chen, X. Yi, Computational Linguistics, pp. 1–55, 2024.
C. Wang, Y. Wang et al., “A survey on evaluation of large language [38] L. Brinkmann, F. Baumann, J.-F. Bonnefon, M. Derex, T. F. Müller,
models,” ACM Transactions on Intelligent Systems and Technology, A.-M. Nussberger, A. Czaplicka, A. Acerbi, T. L. Griffiths, J. Henrich
vol. 15, no. 3, pp. 1–45, 2024. et al., “Machine culture,” Nature Human Behaviour, vol. 7, no. 11, pp.
[13] S. Kolisko and C. J. Anderson, “Exploring social biases of large lan- 1855–1868, 2023.
guage models in a college artificial intelligence course,” in Proceedings [39] B. Wang, “Towards trustworthy large language models,” Ph.D. disserta-
of the AAAI Conference on Artificial Intelligence, vol. 37, no. 13, 2023, tion, University of Illinois at Urbana-Champaign, 2023.
pp. 15 825–15 833. [40] N. Wretblad and F. Gordh Riseby, “Bridging language & data: Optimiz-
[14] A. Laakso, “Ethical challenges of large language models-a systematic ing text-to-sql generation in large language models,” 2024.
literature review,” 2023. [41] A. BARBERIO, “Large language models in data preparation: opportu-
[15] L. Weidinger, J. Mellor, M. Rauh, C. Griffin, J. Uesato, P.-S. Huang, nities and challenges,” 2022.
M. Cheng, M. Glaese, B. Balle, A. Kasirzadeh et al., “Ethical and social [42] V. M. Malode, “Benchmarking public large language model,” Ph.D.
risks of harm from language models,” arXiv preprint arXiv:2112.04359, dissertation, Technische Hochschule Ingolstadt, 2024.
2021. [43] C. Donner, “Misinformation detection methods using large language
[16] S. Harrer, “Attention is not all you need: the complicated case of models and evaluation of application programming interfaces,” 2024.
ethically using large language models in healthcare and medicine,” [44] K. Goswami, “Unsupervised deep representation learning for low-
EBioMedicine, vol. 90, 2023. resourced languages and applications,” 2024.
[17] T. Dyde, “Documentation on the emergence, current iterations, and [45] J. Armengol Estape, “A pipeline for large raw text preprocessing and
possible future of artificial intelligence with a focus on large language model training of language models at scale,” Master’s thesis, Universitat
models,” 2023. Politecnica de Catalunya, 2021.
[18] L. Weidinger, J. Uesato, M. Rauh, C. Griffin, P.-S. Huang, J. Mellor, [46] R. Vázquez, “Representation learning in multilingual neural machine
A. Glaese, M. Cheng, B. Balle, A. Kasirzadeh et al., “Taxonomy of risks translation,” 2023.
posed by language models,” in Proceedings of the 2022 ACM Conference [47] V. C. Stufano, “Esplorare le capacità dei large language models
on Fairness, Accountability, and Transparency, 2022, pp. 214–229. nell’ottimizzare le operazioni della supply chain,” 2024.
[19] K.-F. Lee and C. Qiufan, AI 2041: Ten visions for our future. Crown [48] T. Liu, “Towards augmenting and evaluating large language models,”
Currency, 2021. Ph.D. dissertation, UC San Diego, 2024.
[20] A. Roger, “Training large multimodal language models with ethical [49] Y. S. MOHAMED, “Multicultural emotional reasoning in vision lan-
values,” 2024. guage models,” Ph.D. dissertation, 2023.
[21] M. Hill, “Hallucinating machines: Exploring the ethical implications [50] O. Kjell, K. Kjell, and H. A. Schwartz, “Beyond rating scales: With care
of generative language models,” Ph.D. dissertation, Open Access Te for validation large language models are poised to change psychological
Herenga Waka-Victoria University of Wellington, 2023. assessment,” 2023.
 8

[51] D. Demszky, D. Yang, D. S. Yeager, C. J. Bryan, M. Clapper, S. Chand-

hok, J. C. Eichstaedt, C. Hecht, J. Jamieson, M. Johnson et al., “Using
large language models in psychology,” Nature Reviews Psychology,
vol. 2, no. 11, pp. 688–701, 2023.
[52] T. R. McIntosh, T. Susnjak, T. Liu, P. Watters, and M. N. Halgamuge,
“Inadequacies of large language model benchmarks in the era of gener-
ative artificial intelligence,” arXiv preprint arXiv:2402.09880, 2024.
[53] Z. J. van Rensburg and S. van der Westhuizen, “Ethical ai integration
in academia: Developing a literacy-driven framework for llms in south
african higher education,” in AI Approaches to Literacy in Higher
Education. IGI Global, 2024, pp. 23–48.
[54] A. Barrón-Cedeno, B. Spallaccia, M. Sosto, and I. Session, “Queer-
bench: Quantifying discrimination in language models towards queer
identities,” 2024.
[55] A. Vee, “Essays and reviews in computing and culture,” Interfaces,
vol. 3, 2022.
[56] S. Dev, J. Goyal, D. Tewari, S. Dave, and V. Prabhakaran, “Building
socio-culturally inclusive stereotype resources with community engage-
ment,” Advances in Neural Information Processing Systems, vol. 36,
2024.
[57] Y. Yu, Y. Zhuang, J. Zhang, Y. Meng, A. J. Ratner, R. Krishna,
J. Shen, and C. Zhang, “Large language model as attributed training data
generator: A tale of diversity and bias,” Advances in Neural Information
Processing Systems, vol. 36, 2024.
[58] V. Gadiraju, S. Kane, S. Dev, A. Taylor, D. Wang, E. Denton, and
R. Brewer, “” i wouldn’t say offensive but...”: Disability-centered
perspectives on large language models,” in Proceedings of the 2023
ACM Conference on Fairness, Accountability, and Transparency, 2023,
pp. 205–216.