Preprint
Article

ChatGPT and the Generation of Digitally Born “Knowledge”: How Does a Generative AI Language Model Interpret Cultural Heritage Values?

Altmetrics

Downloads

1101

Views

1182

Comments

0

A peer-reviewed article of this preprint also exists.

This version is not peer-reviewed

Submitted:

07 July 2023

Posted:

10 July 2023

You are already at the latest version

Alerts
Abstract
The public release of ChatGPT, a generative artificial intelligence language model, caused wide-spread public interest in its abilities but also concern about the implications of the application on academia, depending on whether it was deemed benevolent (e.g., supporting analysis and simplification of tasks) or malevolent (e.g., assignment writing and academic misconduct). While ChatGPT has been shown to provide answers of sufficient quality to pass some university exams, its capacity to write essays that require an exploration of value concepts is unknown. This paper presents the results of a study where ChatGPT 4 (release May 2023) was tasked with writing a 1500-word essay to discuss the nature of values used in the assessment of cultural heritage significance. Based on an analysis of 36 iterations, ChatGPT writes essays of limited length of about 50% of the stipulated word count which are primarily descriptive without any depth or complexity. The concepts, which are often flawed and suffer from inverted logic, are presented in an arbitrary sequence with limited coherence and without any defined line of argument. Given that it is a generative language model, ChatGPT often splits concepts and uses one or more words to develop tangential arguments. While ChatGPT provides references as tasked, many are fictitious, albeit with plausible authors and titles. At present ChatGPT has the ability to critique its own work but seems unable to incorporate that critique in a meaningful way to improve a previous draft. Setting aside conceptual flaws such as inverted logic, several of the essays could possibly pass as a junior school assignment, but fall far short of what would be expected in senior school, let alone at a college and university level.
Keywords: 
Subject: Computer Science and Mathematics  -   Artificial Intelligence and Machine Learning

1. Introduction

At the time of writing, artificial intelligence (AI) has reached public consciousness, with a wide-ranging debate on its present and potential future abilities, its dangers and the ethics of its usage. All of this was brought about by the public release of DALL-E (an image generator) and ChatGPT in early 2022. The Chat Generative Pre-trained Transformer (ChatGPT), a generative AI language model developed by OpenAI, is a type of deep learning model that uses transformer architecture to generate coherent and contextually relevant, human-like responses based on the input it receives [1].
From its formal release in 2018, ChatGPT has undergone several iterations and improvements. In November 2022 ChatGPT 3.5 was released to the general public, as a part of a free research preview to encourage experimentation. The current version GPT-4, released in March 2023, was trained (by human trainers) on data set of 175 billion parameters and reputedly exhibits greater factual accuracy, reduced probability of generating offensive or dangerous output and greater responsiveness to user intentions as expressed in the questions/ query tasks [2]. Analysis has shown that the ChatGPT language model memorized a wide collection of books (fiction, non-fiction and scientific), with the degree of memorization correlated with frequency with which passages of those text appear on the web [3,4]. The temporal cut off for the addition of training data was September 2021, which implies that ChatGPT cannot integrate or comment on events, discoveries and viewpoints that are later than that date. It is asserted in public media, however, that GPT-4 has the ability to search the Internet in real time.
ChatGPT has been shown to be capable of writing lines of code [5], producing poetry [6], short stories and plays [7,8,9], English essays [10], as well as producing simulated scientific content (see below)

1.1. The use of ChatGPT in academic disciplinary research

There is a growing body of literature that examines the level of knowledge of ChatGPT as reflected in its responses to several fields of research, such as chemistry [11], the use of remote sensing in archaeology [12], architecture [13], diabetes education [14], medicine [15,16,17,18,19], nursing education [20], agriculture [21] and computer programming [22]. Some papers looked at the use of ChatGPT to write literature reviews [23,24,25].
In addition, some work looked at the ‘perceptions’ of ChatGPT about its future role in some disciplines and professions, such as accounting[26], libraries [27], academia in general [27], medicine [15], medical research [28], health care [29] digital leadership and technology integration [30], or textile manufacturing [31]. Several of these papers make use of the interactive nature of ChatGPT and frame their research as a conversation about the topic [11,12,15,32]. Other research has examined the role and usefulness of CHatGPT in advising or guiding professionals, for example in the fields of medicine such as arthroplasty [33,34], nursing [6], dentistry [35], orthopedic [36] and pediatric research [28].
A growing body of research has been examining the effects of ChatGPT on education and academia in general. At the time of writing, there are two discrete strands of thinking: one that considers ChatGPT as a potential device to enhance learning [35,37,38,39,40,41,42,43,44]; and one that considers its effect on assignment writing and associated student misconduct [32,40,41,45,46,47,48,49]; as well as the integrity of academic writing and publishing in general [50,51,52,53,54,55,56,57,58,59].
As several authors noted, ChatGPT is the typical double-edged sword presented by many new technologies: both useful and detrimental [60]. In response to the threat of AI-generated text to the integrity of assignments and other text, tools have been developed (and are being refined) to assess a block of text for it human vs AI authorship [61,62]. On the other, techniques to evade detection are also being examined [63,64].

1.2. ChatGPT in cultural heritage research

Compared to disciplines such as medicine, there has been little formal exploration of the use of ChatGPT in cultural heritage research and management. So far it has been explored in terms of its knowledge of the potential for remote sensing in archaeology [12], and creating plain language summaries of archeological research reports [65]. Other work looked at the ethical implications of generating ‘new’ content, in textual and pictorial form, and the limitations ChatGPT (and its image generation cousin DALL-E) possess in the cultural sphere [66,67].
The majority of the current discussion on the use of ChatGPT in cultural heritage contexts occurs in the unrefereed blog sphere, with the majority of activity in the museums and collections sphere.
The potential of ChatGPT as a tool for message generation, content marketing and audience interaction can be readily ported to a museum context [68]. There is an emerging potential to use sentiment analysis of general visitor enquiries, specific queries and overall feedback to provide an integrated understanding of visitor interest and reactions to specific exhibitions or the museum overall and to track visitor satisfaction [68,69].
It has been posited that that ChatGPT (or future iterations) can be readily used as generic document and content analysis to extract pertinent data from longer documents and to provide a succinct summary [70], which could be employed in the creation of exhibition texts [71,72] and scripts for audio guides [72], while data extraction from object inventory data can result in the creation of exhibit labels and catalogue information [72] and museum guides [73]. This can be extended in the form of customized tours of exhibits and museum holdings that reflect a visitor’s personal interests or information needs [68,69]. This is readily implementable given the increased digitization of museum holdings and their presentation to the public in the guise of digital exhibits, which was supercharged by the digital pivot required in response to the shuttering of museums during the COVID-19 pandemic [74,75,76,77,78]. Not surprisingly, some concerns have been raised as to how ChatGPT could affect museum studies projects in school curricula encouraging plagiarism and reducing active enquiry [79].
While ChatGPT appears to have considerable success in responding to fact-based tasks [37,47], the question arises whether it can provide similarly valid responses when tasked with explaining theoretical concepts.

1.3. The nature and assessment of values attributed to cultural heritage assets

In broad terms, cultural heritage is the result of peoples’ interactions, both with each other and with the environment in which they live. The outcome of these interactions expresses itself in a number of forms. Peoples’ interactions with each other result in intangible manifestations which find their expression, inter alia, in language, folklore, sounds, skills, cultural knowledge, performing arts and customs,[80,81,82,83] whereas people’s interaction with the environment manifests itself in a tangible form, such as the built and constructed environment, cultural landscapes, resource extraction and refuse sites, as well as in moveable artefacts and objects.[81] Both spheres can overlap where multisensory experiences occur in tangible spaces.[84] Whether these manifestations are deemed cultural heritage depends on the level of importance ascribed to them and the extent to which they are deemed to be important enough to be transmitted on an intergenerational scale by a community or section thereof.
Management processes aim at fostering the conservation and preservation of tangible heritage assets through the identification and intervention of decay processes, [85,86,87] as well as the identification of adaptive reuse options for places that have lost their original function [88,89,90], and the maintenance of intangible heritage assets through documentation and in particular through ongoing practice. Despite public rhetoric that espouses the notion that heritage is being preserved for the future [91,92], this preservation of cultural heritage assets occurs to service present-day desires and aspirations. As such, management cannot presuppose future perceptions of heritage significance [93]. Any preservation of assets, however, affords the next generation the ability to make decisions [94].
Whether heritage assets are ‘worthy’ of preservation and conservation is underpinned by how and to what degree individuals, groups of individuals and entire communities value these assets and what level of importance they ascribe to their preservation. Whether cultural practices and tangible assets inherited from past generations are valued by a present-day community is dependent on the degree to which these define or circumscribe the cultural identity of the group or community and to what extent the current cultural identity is anchored in and dependent on these experiences and traditions.
All attributions of value are anthropogenic, and often also anthropocentric constructs that are projected on an inanimate (e.g., tangible heritage sites and objects) or animate human (e.g., intangible cultural heritage) and non-human world (e.g., the natural environment). Consequently, nothing possesses ‘intrinsic value’ (i.e. valuable in and of itself) unless human individuals, singly or as a group, attribute such value onto a given entity. While the basic needs to be met on Maslov’s pyramid are often attributed intrinsic value (such as food, water and shelter), the history of industrial pollution of air and water demonstrates that the intrinsic values are not universally held. The same applies to the natural environment, which, although ascribed intrinsic value by ecologists and ethicists [95], has long been regarded as exploitable in a knowing fashion, even to the extent of the extinction of species or the exhaustion of natural ‘resources’. In view of their anthropogenic origin both the nature and the perceived importance of values will differ between individuals and groups of people, wherein cultural traditions and group identity shape, define and consolidate these values. Humans as social creatures are embedded in a complex web of past and present interpersonal, intra- and inter-group and community relationships. These relationships result in—and shape—a person-centred equally complex web of values that we project on the various expressions of heritage and that are contingent in strength on the valuer’s position in their social space at that point in time. Differences in the perception of values, which can be perceived as positive, neutral or negative, may result in value trade-off or, where non-negotiable, in value conflicts [96,97,98].
The authorized heritage discourse (sensu Smith) is founded on four axiomata, namely that tangible cultural heritage assets are scarce; finite; non-renewable and valuable. It posits that heritage assets are inherently valuable with some authors even attributing intrinsic value [99]. The authorized heritage discourse commonly relies on the identification and assessment of four sets of heritage values, aesthetic, historic, scientific and social value, which are enshrined in many formal charters, standards, regulations and guidelines [100,101,102,103,104,105]. The assessment of these values leads to a determination of heritage significance, from which all management and conservation actions flow (or the abstention therefrom). The assessment of these values, however, is prone to be influenced by the dominant culture and by professional practitioners [81,106,107,108,109]. While some of this can be overcome with broad-based consultation or even community-based assessment and co-creation [102], intra-group dynamics will influence the process [110].
Heritage values and the significance derived therefrom are neither universal nor are they static. Rather, as expression of a culture, they are culturally relative entities [111,112] and subject to an individual’s cultural positioning [113] and also mutable entities due to changing professional [114,115] and intergenerational perceptions and perspectives [116]. Indeed, the past two decades have seen a widened understanding of the interpretation and application of values, in particular in terms of gender [117,118] and Eurocentrism [119,120,121], with studies looking at the epistemological basis of the various conceptualizations and descriptors of values attributed to heritage (instrumental, authenticity etc.) [122].
While most of scholars see the instrumental value of heritage in terms of identity, [123,124,125,126], the tourism literature in particular examined the instrumental value of heritage, both in its tangible and intangible manifestations to the tourism product and the economics derived therefrom [127,128,129].
Any discussion of the specifics of heritage values projected on tangible and intangible manifestations will depend on the cultural positioning and standpoint of the valuer. Although numerous approaches are possible, all discussions should cover aspects of the authorized heritage discourse, cultural relativity, the subjectivity of assessment and the mutability of values.
While people can balance these aspects and can provide an essay with a nuanced exposition, it is unclear to what extent AI can do the same. This paper will examine the ability of ChatGPT to write a comprehensive essay which discusses the nature of values used in the assessment of cultural heritage significance and to assess the extent of ChatGPT’s understanding of the topic and its ability to provide a nuanced discussion.

2. Methodology

2.1. Data generation

2.1.1. Essay task

The study used OpenAI’s ChatGPT 4.0, May 24 Version (https://chat.openai.com accessed 16 June 2023) to generate an essay with the following set task: “Write a 1500 word essay that discusses the nature of values used in the assessment of cultural heritage significance. Provide references.”
Run Set A & B: Twelve iterations of the task were run on 16 June 2023 between 12:45 and 13:15 AEST (2:45–3:15 GMT) and another twelve between 14:00 and 14:15 AEST (4:00–4:13 GMT). The system was prompted to “continue generating” until the essay was completed. Once completed, the text was copied and the system was requested to regenerate the response, using the provided button. No feedback was provided to the system as to whether the completed task was deemed to be adequate or not. During these two sets of runs the ‘chat’ was left open, whereby ChatGPT added the new versions and retained the previous ones, allowing the user to backtrack if needed.
Run Set C: Twelve iterations of the task were run on 17 June 2023 between 12:45 and 13:00 AEST (2:45–3:00 GMT). As before, the system was prompted to “continue generating” until the essay was completed. Once completed, the text was copied. In this set, however, the ‘chat’ was deleted after each task completion and each new chat was initiated.

2.1.2. Reference query

On 17 June 2023 at 14:35 AEST (4:35 GMT) ChatGPT was tasked with the following request: “Cite 20 references on cultural values in cultural heritage management.” Once these were delivered (including being prompted to “continue generating”), ChatGPT was tasked with the follow up request “can you cite 20 more?” following which 20 more references were delivered (including being prompted to “continue generating”). Following the delivery, ChatGPT was asked for detail on the origin of the references (‘Where did you get these references from?’ and ‘Did you source some of these references from Wikipedia?’).
After the previous chat was deleted, a new chat was initiated at 14:43 AEST (4:43 GMT) with the query “Cite 50 references on cultural values in cultural heritage management.” ChatGPT baulked at the request due to server-demand issues (“providing 50 references in a single response would be quite overwhelming and space-consuming”) and offered 10 references. It then provided additional references in response to the follow-up request of “can you provide me with 30 more?”
The veracity of all references was ascertained through title searches in GoogleScholar.

2.2. Data Analysis

The technical aspects manuscript files were analyzed using the editorial reporting functions in Word for Microsoft 365 that provide descriptive data on the text, such as the number of words, paragraphs and sentences, as well as reading levels.
The content of the essay manuscripts was analyzed in terms of coverage of topics, and the structure, coherence and complexity of the argument.

3. Results

The results will be presented in the following order. First we will address the technical aspects of essays generated by ChatGPT in terms of the reading age and word count, as well as the references that were cited in these essays. This is followed by a discussion of the results of the of the reference queries. The section concludes with an examination of the essay response with specific focus on the coverage of topics, and the structure, coherence and complexity of the argument,

3.1. Technical aspects of the essay task

3.1.1. Reading age and wordcount

Although ChatGPT had been tasked with writing a 1500-word essay, three quarters of the generated essays were of less than half the required length (Figure 1), with an overall average of 710.9±60.0 words (n=36). The longest essay comprised 933 words (Table 1) (for general descriptor of each essay, see Appendix A, Table A1).
The complexity of a given text, and the associated reading age or grade level, can be assessed with numerous metrics. The most common of these is the Flesch-Kincaid readability test which takes into account the number of sentences, words and syllables in the words [130], and which expresses the complexity in terms of (US) grade levels. This ranges from 4.8 to 6.5 for recreations books, 13 to 15 for textbooks used in tertiary education and in excess of 17 for scientific writing [131,132,133]. Among the latter category a trend of increasing complexity has been observed [133]. The Flesch-Kincaid score for the essays written by ChatGPT ranged between 16 and 19.5, with an overall average of 17.8±0.9 (n=36; Table 1).

3.1.2. References cited in the essay task

As part of the essay task, ChatGPT was asked to provide references. The majority of the iterations generated by ChatGPT cited between four and five references (Figure 2) which, with few exceptions, were presented in alphabetical sequence. Where not in alphabetical order, the sequence of genuine references seems to reflect the order in which sources were drawn upon.
With two exceptions, none of the statements in the essay texts were referenced within the paragraphs, with references given in the form of a bibliography at the end. In both instances, where essays referenced assertions made in the text within the paragraph (essays A4 and B12), each paragraph of the body of the essay (excluding the introduction and the conclusion) carries one reference. The references are broadly contextual but the relevance of each citation was drawn from a key term in its title (with one additional fictitious reference in essay B12).
ChatGPT explicitly commented in one essay (A1): “It will draw upon scholarly references and case studies to support the discussion.” The reader has to assume that the references are genuine and generally there is no indication by ChatGPT that this may not be the case. Only one iteration (B9), which cited a single, fictitious reference, added the following caveat at the end the manuscript text: “Note: This essay is a product of an AI language model and the references provided are fictional. Please consult academic sources for authentic references on the topic.”
To a casual user who is not firmly familiar with the literature, however, all references appear valid because i) the titles appear plausible; ii) journal titles are those of genuine publications and iii) and the vast majority of authors names were those of academics publishing in the fields of cultural heritage of archaeology or were cultural heritage organizations such as UNESCO or ICOMOS. Only 6.0% of the authors ‘cited’ did not publish in the discipline, with another 1.8% being dual nonexistent author combinations where one author did publish in the relevant fields.
The veracity of all references was verified through title searches in GoogleScholar. Depending on the run set, between 40% and 56.4% of the references existed, while between 23.6% and 40% of the references were entirely fictitious (Table 2).
Seven references occurred more than twice, all of which are genuine:
  • Smith, Laurajane. Uses of heritage. Routledge, 2006 (25 ‘citations’)
  • ICOMOS Australia. (2013). The Burra Charter: The Australia ICOMOS charter for places of cultural significance 2013. Burwood, Vic: Australia ICOMOS Inc. International Council of Monuments and Sites (15 ‘citations’)
  • United Nations Educational, Scientific and Cultural Organization (UNESCO) (1972). Convention Concerning the Protection of the World Cultural and Natural Heritage. version: Paris (1972) (8 ‘citations’)
  • United Nations Educational, Scientific and Cultural Organization (UNESCO). "Convention for the safeguarding of the intangible cultural heritage." Paris (2003) (7 ‘citations’)
  • Waterton, Emma, and Laurajane Smith. "The recognition and misrecognition of community heritage." International journal of heritage studies 16.1-2 (2010): 4-1 (7 ‘citations’)
  • Waterton, Emma, and Steve Watson, eds. Heritage and community engagement: Collaboration or contestation? Routledge, 2013 (5 ‘citations’)
  • Bandarin, Francesco, and Ron Van Oers. The historic urban landscape: managing heritage in an urban century. John Wiley & Sons, 2012 (4 ‘citations’)
An examination of the non-existent references shows that these were generated using the names of real authors working in the field (in the main) with fragments of real article titles, journal or publisher names and DOIs to construct false but realistic looking references. An example is the following reference (iteration A5, reference 4):
Matero, F. (2010). Cultural Heritage Conservation and Environmental Impact Assessment by Nancy Odegaard, Scott Carroll, Werner Zimmt, with Katherine Rankin. Journal of the American Institute for Conservation, 49(1), 65-66. doi:10.1179/019713610803315317
This reference can be deconstructed as follows:
Matero, F. Frank Matero (genuine author)
(2010). Plausible year
Cultural Heritage Conservation and Environmental Impact Assessment by Fragment taken from: Van Grieken, R., & Janssens, K. (Eds.). (2004). Cultural heritage conservation and environmental impact assessment by non-destructive testing and micro-analysis. CRC Press.
Nancy Odegaard, Scott Carroll, Werner Zimmt. Fragment taken from: Nancy Odegaard, Scott Carroll, and Werner Zimmt. Material characterization tests for objects of art and archaeology. 2000
with Katherine Rankin. various sources possible
Journal of the American Institute for Conservation genuine journal title
49 correct journal volume number for the year 2010
(1) issue 1 exists
65-66. formal issue ends with page 64, end matter on pp. 65-66
doi:10.1179/019713610803315317 non-existent DOI

3.2. Results of the reference queries

3.2.1. Query 1: 20 plus 20 references

Upon request, ChatGPT provided a set of twenty references and, when prompted, another set of twenty. The veracity of these references was again ascertained through title searches in GoogleScholar. The accuracy references were classified according to four categories: title, author, year, publisher (or journal).
Of the forty references, twelve publications did not exist at all, but their fictitious titles had been constructed (set 1: 4; set 2: 8). As before, all these fictitious titles sounded quite plausible. Nine of the references provided an existing title but incorrect authors (set 1: 5; set 2: 4), while another ten provided an existing title with the correct authors (and commonly the correct publisher) but offered the wrong publication year (set 1: 5; set 2: 5). Only nine references had correct publication details (set 1: 6; set 2: 3). The references included the names of 50 authors, four (8%) of which have not published in the fields of fields of cultural heritage or archaeology.
ChatGPT provided the following caveat at the end of the first set of 20 references: “Please note that while I have provided the references, it is always a good practice to review and evaluate the sources for their relevance and credibility before using them in academic or professional work” and the following caveat after the second twenty references “Remember to evaluate the sources for their relevance and credibility before using them in academic or professional work.” At no point did ChatGPT offer any indication that over half of the references were fictitious or seriously flawed (incorrect authors).

3.2.2. Query 2: 50 references

When ChatGPT was tasked to generate “50 references on cultural values in cultural heritage management” the system baulked and offered ten references (set 1) but provided an additional thirty (set 2) when prompted. Of the forty references thus generated, six publications did not exist at all but had constructed fictitious titles (set 1: 4, set 2: 2). As before, all of these fictitious titles sounded quite plausible. An additional two titles were mis-constructed by merging the titles of the article and the book into one (both set 2). Four of the references provided an existing title but incorrect authors (set 1: 1; set 2: 3). Another four provided an existing title with the correct authors (and commonly the correct publisher) but offered the wrong publication year (all set 2). Fourteen of the references had had correct publication details (set 1: 5; set 2: 9), with two publications doubled up (both set 2)
The references included the names of 40 authors, eight (20%) of which have not published in the fields of fields of cultural heritage of archaeology.

3.3. Nature of the essay response

3.3.1. Coverage of topics

The topics covered in the exposition section of each essay were extracted and classified as value descriptors and as assessment concepts, using the primary terms provided by ChatGPT. No attempt was made to integrate or assign them to classes (for individual data see Appendix A Table A2).
When considering the value descriptors, those four values which are associated with the authorized heritage discourse (aesthetic, historic, scientific and social value) dominate, with all four being reflected in over half of all essays (Table 3). Among these, historic value dominates, followed by social value. The only other value concept that has more recently been recognized in the heritage assessment literature, that of spiritual and religious value, is mentioned in just under a third of the essays. All other value descriptors are either uncommon constructs (e.g., ‘identity value’, ‘tourism value’, ‘tangible vs. intangible values’) created by ChatGPT, are concepts that are discussed but not generally recognized in the heritage assessment literature (e.g., ‘intrinsic value,’ ‘economic value’) or are value descriptors that are commonly regarded as subsets or exemplifications of overarching concepts (e.g., ‘educational value’, ‘artistic value’).
When considering concepts for assessing values and their limitations, three concepts recur in more than half the essays: the subjectivity of values, the concept of the evolving societal perspectives and stakeholder engagement (Table 4). A fourth, cultural relativism, was mentioned in just under half of the essays (47.2%), followed by value hierarchies and value conflicts (38.9%).
A correlation of the inclusion of the values of the authorized heritage discourse against the five most frequent concepts for assessing values follows the pattern of overall representation and no deviations from the expected pattern emerge (Table 5).

3.3.2. Structure of the essay argument

Given the concept of ChatGPT as a generative AI language model, it is not surprising that each of the 36 essays are different. All essays written by ChatGPT follow the generally accepted practice of constructing an essay (introduction, exposition, conclusions), with the exposition section commonly structured as a description and definition of a select set of values to be followed by broader concepts and limitations.
In all bar three iterations, ChatGPT starts the essay with a paraphrased definition of Cultural heritage, which is expressed in terms of “Cultural heritage encompasses…” (12 iterations), “Cultural heritage is a collective expression of …” “human creativity and history,” “reflection of a society's history, values, and identity,” “a rich and diverse tapestry of human achievements,” ”a vital aspect of human civilization; “Cultural heritage plays a crucial role in defining / preserving / shaping a society's identity,” and “Cultural heritage holds immense value…” This is then followed by a sentence that refers to cultural heritage significance and is relevance. The final sentence of the introduction routinely commences with “[t]his essay aims to explore / examines / delves into the nature of values used in the assessment of cultural heritage significance”, heavily drawing on the set task (“Write a 1500 word essay that discusses the nature of values used in the assessment of cultural heritage significance”).
The expositions of essays fall into four groups: one group focusing on the values espoused by the authorized heritage discourse (sensu Smith); one group that framed their exposition in overarching, more fundamental concepts of values (intrinsic vs instrumental) values; one group that framed their exposition in terms of heritage significance; and one group that started their exposition with commentary on the subjectivity of values.
Slightly more than one third of the essays (14) focused on an exposition of various discrete values as utilized in the authorized heritage discourse. Half of these prefaced the exposition with a framing that defined cultural heritage values and their multi-facetted nature (Table B1). Every essay either commented on subjectivity or cultural relativism. Of the others, seven framed the exposition in terms of cultural heritage significance, following the standard heritage discourse of assessment and role played by the various values (Table B2). Three commented on subjectivity or cultural relativism, while the others diverged considerably. The remaining essays simply described the heritage values without specific framing, one of which did so without any contextualization or qualification (Table B3).
A second group of seven essays framed their exposition in overarching, more fundamental concepts of values. These essays lead off with a description of intrinsic values followed by a section on instrumental values (5 essays). Thereafter the expositions diverge considerably without any discernable clear pattern, generating individual essays that all cover different aspects with a different emphasis (Table B4).
A third group of five essays framed their exposition in terms of heritage significance (Table B4), but then widely diverged in their line of argument (A10, B3, B7, C5, C10). Three additional essays framed their exposition as “understanding cultural heritage values” (A5, A9, C7). Common to all is that the level of exposition also involves overarching, more fundamental concepts of values, with common aspects of subjectivity and cultural relativism. Again, ChatGPT generated individual essays without any discernable clear pattern that all cover different aspects with a different emphasis.
The fourth group started their exposition with commentary on the subjectivity of values, with two essays progressing to comment on the diversity of values and their evolving nature (Appendix B, Table B6). Again, all essays are individual in their approaches and emphasis. One of these included a case study (Sydney Opera House), an approach that had not been taken by any of the other iterations (essay B9).
The remaining two iterations (essays A12 and C3) commenced with a discussion of the multidimensional nature and the subjectivity cultural heritage values and then also diverged, again discussing overarching, more fundamental concepts of values.

3.3.3. Coherence and Complexity of the argument

When considering the essays, the two framing sentences in the introduction set out the general focus of the paper, while the following sentence merely repeats the essay task. While the essays broadly follow what the first two sentences of the introduction that signal is the focus of the essay, the exposition itself often does not follow this. While the exposition section is generally structured as a description and definition of a select set of values (or criteria) followed by broader concepts and limitations, there is no coherent line of argument. Instead, the exposition is a sequence of discussion points that are commonly presented in an unconnected form. The discussion section seemingly provides a generic summary, but when examined more closely, reflects only part of the exposition and does not tie back to the aims as stated in the introduction. The following example (essay A7) may is one such example.
Introduction: Cultural heritage plays a vital role in shaping our identities, understanding our history, and fostering a sense of community. As societies evolve, it becomes crucial to assess and evaluate the significance of cultural heritage sites and objects. However, the assessment of cultural heritage significance is a complex process that involves a range of values. This essay explores the nature of values used in the assessment of cultural heritage significance, highlighting their diversity and the influence they exert on the preservation and interpretation of our shared heritage.
The introduction is straightforward and sets up expectations regarding a discussion of the nature and diversity of values, but also their role in heritage preservation and interpretation. The following exposition presents eight topics as numbered dot points in the following order:
  • Cultural Heritage Significance
  • Intrinsic Values
  • Historical Values
  • Aesthetic Values
  • Social Values
  • Spiritual and Religious Values
  • Scientific Values
  • Cultural Diversity and Multicultural Values
The lead paragraph, which clearly follows the authorized heritage discourse, notes that: “Cultural Heritage Significance: Cultural heritage significance refers to the value and importance ascribed to a particular heritage site or object. Significance assessment enables us to understand and prioritize cultural heritage resources for conservation, management, and interpretation. It involves examining both the tangible and intangible aspects of cultural heritage, including historical, aesthetic, social, spiritual, and scientific values.”
Instead of following its outline sequence, ChatGPT first proceeds to discuss ‘intrinsic values’, which it constructs as follows: “Intrinsic values refer to the inherent qualities and characteristics of cultural heritage that make it valuable in and of itself. These values are independent of human perceptions and interactions. For instance, the age, rarity, and authenticity of an artifact contribute to its intrinsic value. Intrinsic values are essential in determining the uniqueness and irreplaceability of cultural heritage, guiding decisions on preservation and conservation.”
Setting aside the problematic definition of ‘intrinsic value’ (see discussion), there has been no lead-in that considers the anthropogenic, and often anthropocentric, nature of values, within which the concept of intrinsic value needs to be situated. Rather than building on this by considering and outlining instrumental values, ChatGPT picks up its outline and presents the ‘standard’ values as prescribed by the authorized heritage discourse: historical, aesthetic, social, spiritual & religious; and scientific values. Each of these sections is written as a standalone paragraph without any connection to the previous or the following section. There is also no attempt made to arrange the sequence in in a logical structure, such as presenting the values with increasing or decreasing levels of subjectivity.
The final numbered section, which covers ‘cultural diversity and multicultural values,’ highlights that cultural heritage encompasses a ‘diversity of human experiences and perspectives’ and the ‘importance of different cultures, traditions, and languages.’ This section does not follow from the previous section nor is it signposted in the beginning. It is also purely descriptive and fails to comment on cultural relativism.
The conclusion section briefly summarizes the exposition, but does not draw out any common threads, nor does it highlight the importance of the nature of values or any commonalities they may have: “The assessment of cultural heritage significance is a multifacet [sic] process that requires the consideration of various values. Intrinsic, historical, aesthetic, social, spiritual, scientific, and cultural diversity values collectively contribute to our understanding of cultural heritage and inform decision-making processes. Recognizing and valuing this diversity of values is essential to ensure the preservation, interpretation, and enjoyment of our shared heritage for present and future generations.”
Overall, there is little coherence to the argument within the essay, as the sequence is arbitrary, without any defined thread and the text is basic, without any depth or complexity. Setting aside conceptual flaws such as inverted logic in some of the sections, the essay could possibly pass as a junior school assignment but falls far short of what would be expected in senior school, let alone at a college and university level.

4. Discussion

As noted, ChatGPT returned essays with an average word count of 710±69 words, although it had been tasked with writing a 1,500-word essay. None of the essays were longer than 62% of the prescribed length. The limitation of ChatGPT to provide answers well below the stipulated word range has been observed by other authors [45,47,49,134]. It can be speculated that this is due to instructions delivered during the training phase to generate comprehensive and succinct responses, in favor of more detailed and nuanced discussions, even though the word count would permit this.

4.1. References

The small number of genuine references, which are ‘cited’ more than twice, suggests that these were part of the input that may have been used to train the model. It was anticipated that ChatGPT would generate its references using keywords or word combinations derived from the query task and connecting these to select sources that were fed into the model during its training. Yet, as the results show, a large number of references are entirely fictional or flawed in terms of authorship or year of publication. It is of interest to note that in only one of the 36 iterations of the essay task the reader advised that “the references provided are fictional.” In the first query task that required ChatGPT to provide 20 +20 references, the reader was exhorted to “evaluate the sources for their relevance and credibility before using them in academic or professional work.” That would, of course, expose the false references. In a plagiarism and academic misconduct setting, however, it can be posited that such references would have been inserted without verification.
In the second query run, ChatGPT baulked when it was required to generate “50 references on cultural values in cultural heritage management.” As noted, it offered only ten references, apologetically commenting that “providing 50 references in a single response would be quite overwhelming and space-consuming.” Significantly, it prefaced the supply of these ten references with the comment “However, I can certainly provide you with a list of 10 reputable references on cultural values in cultural heritage management.” Despite the claim of having provided “reputable references”, four of the ten did not exist at all and represented publications were constructed of fictitious titles, with an additional reference that cited an existing title but listed incorrect authors.
Again, this poses serious problems, as the casual, non-specialist reader is being mislead. The use of false references in ChatGPT written essays has been observed in other discipline areas [40,135,136,137,138,139].

4.2. Constructs

Three essays claim a level of authoritativeness when they asserted, in their introduction, that they were “[d]rawing on scholarly literature / sources” (A8, B11, C1) and “expert opinions” (B11) or “examples from cultural heritage practices worldwide” (C1), yet two of the three essays each contain a fictitious reference.
At a superficial glance the types of values that are included in the essay responses make sense, but the responses are patchy and a more in-depth examination exposes problems that seem to be due to the generative nature of ChatGPT, and which highlight its limitations. In the following we look at a select number of examples, which are representative, but by no means exhaustive.
Consider the following, which at first sight appears reasonable: “Historic values are concerned with the historical context, narratives, and events associated with cultural heritage. These values emphasize the significance of heritage in conveying historical knowledge and understanding. Historical values often emerge from the connection between heritage and significant events, figures, or periods in history. For example, a site where a historic event occurred may be considered culturally significant due to its historical value” [essay A8]. Upon closer examination, the second sentence is fundamentally flawed as it inverts the conceptual sequence. It constructs historic value as ‘emphasiz[ing] the significance of heritage in conveying historical knowledge.’ In common usage by the heritage profession, heritage assets may indeed be attributed historic value if they contribute significantly to our understanding of the course or pattern of an area’s history.[102] The overall heritage significance, however, is derived from the nature and strength of that contribution and not the other way round.
In another example, one essay presents the ‘category’ of ‘Historical and Associative Values’ and expounds as follows: “Historical values pertain to the significance of a heritage element in relation to past events, periods, or people. Associative values refer to the connections between a heritage element and individuals or groups who have interacted with it, such as cultural, religious, or political associations. These values highlight the importance of heritage as a record of collective memory and identity” [essay B10]. This highlights two fundamental problems. The first sentence again inverts the conceptual sequence. It again constructs value as to whether a ‘heritage element’ has significance ‘in relation to past events, periods, or people.’ The second sentence is a mélange derived from British approaches to heritage assessment [104,140]. While these sources use historic associative value, this does not relate to ‘cultural, religious, or political associations’ as constructed by ChatGPT, but relates to an asset’s “association with a notable family, person, event, or movement’ [104]. The ChatGPT AI language model appears to have split ‘historic associative value’ into historic and associative value and then proceeded to split ‘people’ into ‘individuals or groups’ and also to assume an equivalence of ‘associative’ with ‘associations.’
A third example is the treatment of ‘social value’ in a different essay (A7). ChatGPT states that “[s]ocial values highlight the role of cultural heritage in society and its impact on communities. They encompass the sense of identity, pride, and belonging that individuals and communities derive from their heritage. Social values also include the educational, inspirational, and recreational opportunities provided by cultural heritage.” Once again, this is an inverted logic. Social value does not “highlight the role of cultural heritage in society” but is derived from the importance that communities (or sections thereof) attribute to heritage assets or practices and that are instrumental to the social or cultural wellbeing of that community. While cultural heritage undoubtedly provides educational, inspirational, and recreational opportunities, these are not social values as used in heritage assessment.
The same essay notes that “[a]esthetic values pertain to the artistic and visual qualities of cultural heritage. They encompass the beauty, craftsmanship, and creativity of artifacts, architecture, and landscapes. Aesthetic values evoke emotional responses and are instrumental in creating a sense of awe and appreciation.” Once again, aesthetic values do not evoke ‘emotional responses’ and a ‘sense of awe and appreciation’ to cultural heritage assets, but the perception of such responses may contribute to a notion that aesthetic value can be attributed to a cultural heritage asset. Yet, when examining other values discusses in the same essay, such as scientific value or spiritual values, the logic is not inverted and the explanations are quite reasonable.
While many essays make reference to the subjectivity in evaluation (66.7%); cultural relativism (47.2%) and evolving societal perspectives (52.8%) (Table 3), none of them frame values as anthropogenic, and often anthropocentric constructs that are projected on inanimate objects, structures and landscapes or on people’s cultural activities and practices. This lack of fundamental understanding results in ChatGPT presenting the concept of ‘intrinsic value’ in a third of the essays (Table 3), with formulations such as “[i]ntrinsic values pertain to the inherent qualities and attributes of cultural heritage, such as its aesthetic, historic, scientific, or spiritual significance” (essay C11). In almost all instances, the aesthetic/artistic, scientific, spiritual, or historical qualities of heritage items are drawn upon to exemplify ‘intrinsic value’ (essays A4, A11, B2, B4, B8, B11, C11). The definition of intrinsic value as inherent worth is derived from finance theory [141] with wide application among environmental ethicists [142,143]. Except possibly for a small segment of fundamentalist heritage professionals, aesthetic, historic, scientific, or spiritual values would not be construed as intrinsic, but as instrumental and part of community wellbeing [124].
A more elevated comment is made in essay A7, where ChatGPT expounds that “[i]ntrinsic values refer to the inherent qualities and characteristics of cultural heritage that make it valuable in and of itself. These values are independent of human perceptions and interactions. For instance, the age, rarity, and authenticity of an artifact contribute to its intrinsic value.” Contrary to its assertions that the cite value examples “are independent of human perceptions,” both ‘rarity’ and ‘authenticity’ are subjective and mutable constructs, while ‘age’ can also subject to evidentiary biases–all of which are “independent of human perceptions and interactions.” It appears that ChatGPT conflates the ontological components of artefacts with their value.
ChatGPT juxtaposes these intrinsic values with instrumental values, which refer ‘to the usefulness or benefits that cultural heritage provides to society beyond its inherent worth. It includes economic, social, educational, and environmental dimensions’ (essayA4). Again, in all instances where instrumental values were referred to (essays A4, B2, B8, B11, C11), the exemplification involved economic (incl. tourism), educational, and social benefits, including ‘community cohesion’ and ‘sustainable livelihoods’ (the latter essay B2).
A further example of confused logic is a section in an essay, which notes that “[e]thical and spiritual values are integral to the assessment of cultural heritage significance, particularly when considering indigenous or sacred sites. These values encompass the rights, beliefs, and practices of communities that have a deep spiritual or ancestral connection to the heritage element. Respecting these values is crucial for ethical and culturally sensitive heritage management” (essay B7). While it is appropriate to respect spiritual values held by First Nations communities when engaging in ethical and culturally sensitive heritage management, these are not ethical values associated with heritage assets, but professional ethics. That this confused logic is not aberration is underlined by, another essay which noted that “[e]thical considerations and intangible values are integral to the assessment of cultural heritage significance. Ethical values address issues such as ownership, repatriation, cultural appropriation, and the impact of heritage management practices on local communities” (essay C2).
The concern with these, and a plethora of other examples, is that such formulations can pass careless or cursory reading. Moreover, members of the general, non-specialist public are less likely to identify such shortcomings.
One of the limitations of ChatGPT seems to be that while the resulting product is plausible in language and expression, it suffers from inverted logic, as shown above. The following observation suggests that this is, at least in part, caused by initial word substitution, which then sends ChatGPT off track.
As noted in the introduction, cultural heritage manifests itself in tangible and intangible forms. All of these relate to outcomes of peoples’ interactions, both with each other and with the environment in which they live. In several essays discussing cultural heritage values, ChatGPT commingled the concept of tangible and intangible heritage with tangible and intangible values (essays A5, B7, C2, C5, C8, C10). Clearly, as all values are intangible concepts that are projected on tangible (and intangible) products of a community, the concept of ‘tangible value’ is an oxymoron. In most instances, ChatGPT drew on definitions of tangible and intangible heritage and substituted ‘value’ for ‘heritage.’
One essay includes a section on environmental and natural values, where ChatGPT expounds that “[c]ultural heritage is not limited to man-made structures and traditions but also includes natural landscapes, ecosystems, and biodiversity… Evaluating the environmental values of cultural heritage ensures the integration of conservation efforts with cultural preservation” (essay C8). Several papers comment on the fact that there is a continuum between natural and cultural heritage [144,145] even though value conflicts are not uncommon [98]. In this example ChatGPT seems to have used a snippet of information related to this nexus, and, possibly triggered by the mention of cultural landscapes, focused on the noun and substantive term of ‘landscapes.’ From this it then constructed the notion that natural landscapes, ecosystems, and biodiversity are manifestations of cultural heritage.
Another example is the assertion by ChatGPT that heritage assessments can be based on objective criteria, but then proceeds to exemplify this with “historical importance, architectural or artistic merit … and scientific value,” all of which are subjective criteria held by sections of society. In the interpretation of the ChatGPT model, these are somehow different from the subjective values which the essay addresses in the subsequent paragraph, and which are noted as being “deeply rooted in cultural, social, and personal perspectives” (essay B3).
As noted in the discussion of the example presented in the results section, and which applies to all essays assessed in this paper, there is, overall, little coherence to the argument made in each essay. The sequence of the argument in each exposition seems arbitrary without any defined thread and appears to be triggered by the sequence of terms and concepts enumerated in the introduction. In essays written by humans, the argument is structured, and commonly completed, before the introduction and conclusions are written, which can then tightly frame and summarise the arguments made. At this point in its development, ChatGPT does not seem to be able to reflect on the coherence of its argument and improve the text before it is presented. The complexity of the argument is also left wanting.

4.3. Can GhatGPT reflect on and improve its own work?

While writing this discussion section, it seemed apposite to assess whether ChatGPT can provide some reflection and then integrate that reflection into a better version. A separate conversation was carried out (for full text see Appendix E). As before, ChatGPT was tasked to “Write a 1500 word essay that discusses the nature of values used in the assessment of cultural heritage significance” and to provide references. In response it generated a 673 word essay (incl. six references), that framed the exposition by stating that “determining the value of cultural heritage involves a complex interplay of subjective and objective factor” and that the essay would “ explore the nature of values … highlighting the multidimensional and dynamic nature of these values.”
The exposition then presented the reader with the following seven groups of values: ‘tangible and intangible values;’ ‘historical and social values;’ ‘aesthetic and artistic values;’ ‘symbolic and spiritual values;’ ‘environmental and sustainable values;’ ‘economic and tourism values;’ and ‘community and identity values.’ Each of these was comprised of a descriptive sentence or two followed by a sentence that outlined what would be required to assess the respective value (e.g., “Evaluating these values requires an understanding of the historical context and societal dynamics that shape the heritage's significance”).
In common with all previous essays presented by ChatGPT, the essay lacked coherence and linkages, and also lacked overall complexity. In the same session, ChatGPT was then provided with the following prompt: “What are the shortcomings in the essay that you just wrote?”
To this, ChatGPT responded thus: “To enhance the essay, it is recommended to revise the content by addressing these shortcomings, incorporating in-text citations, providing more diverse perspectives, including contemporary examples, discussing the challenges of balancing values, and exploring the dynamic nature of cultural heritage values.” It then proceeded to provide explanatory two-sentence paragraphs to each of these points. Two of these relate to the mechanics of an essay (‘lack of in-text citations,’ ‘absence of contemporary examples’), while the remaining three are apposite critiques, such as ‘limited coverage of perspectives,’ ‘insufficient discussion on balancing conflicting values’ and ‘limited discussion on the dynamic nature of values.’ The explanations of these three points, as provided by ChatGPT, provide reasonable pointers to revise the essay. There are obviously numerous other concepts that have been considered, that ChatGPT used in other iterations of the essay, such as cultural relativism, the subjectivity of values, or the concept of the evolving societal perspectives.
ChatGPT was then provided with the following prompt: “Can you rewrite and improve your initial essay by incorporating the critique that you just wrote? Keep in mind that the word limit is 1500 words, so have more room to expand your discussion.”
Based on this instruction, ChatGPT returned an 844-word essay (incl. ten references). The new essay followed the first attempt in structure and content. A side-by-side comparison revealed that while the introduction had changed, the bulk of the text of the exposition remained the same. For each of the points made, ChatGPT rewrote the final sentence that outlined what would be required to assess the respective value. This reformulation, which rarely goes beyond paraphrasing, does not introduce any new dimensions of the values discussed. In the case of aesthetic and artistic values it does add the comment that “[i]ncorporating contemporary examples, such as modern art installations, helps to highlight the dynamic nature of aesthetic values.” Throughout the revised text fails to incorporate in-text citations, fails to provide more diverse perspectives, fails to discuss the challenges of balancing values and fails to explore the dynamic nature of cultural heritage values.
Based on the example provided in this paper, as well as repeat examples, ChatGPT seems to be able to highlight shortcomings in its own work, but then fails to integrate and incorporate these into a new essay that is substantively different from the initial attempt.

5. Conclusions

It must be stressed that the observations made in the foregoing pages apply to ChatGPT and like? software at this point of the development cycle. The critical inhibitor seems to be that the model needs to be able to integrate materials that are being fed into it, and that it needs to be trained in its responses. At present, this entails both a limited set of materials that were made accessible to the system and a set cut-off date (September 2021 for ChatGPT). The nature and quantity of the source material fed into it will determine the “knowledge base” and thus the responses provided. As noted, criticism has been levelled at the apparent biases that seem to be reflective of the choice of materials made available during the training phase.
When users prompt ChatGPT to regenerate its response to a task, they are prompted to judge whether the response is better than the previous one. While this allows ChatGPT to learn the user-perceived quality of its responses, it can also introduce user-specific biases into the system that can be exploited by malevolent actors.
It can be posited that a future iteration of ChatGPT will be able to progressively and iteratively access newly published information, for example new issues of academic journals that are being published via OpenAccess, and integrate these new data into its responses.
Also, and again at this point of the development cycle, ChatGPT has the fundamental limitation of being limited to integrate and summarize information. While it possesses the capability to critique it is own work, it does not possible the ability to integrate this in a meaningful manner into a revision, even if asked.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The author declares no conflict of interest.

Appendix A. Data Tables

Table A1. General descriptors of the documents analyzed in this paper.
Table A1. General descriptors of the documents analyzed in this paper.
Itera-
tion
Word
Count
Refe-
rences
MS Word
Editor
Score %
Para-
graphs
Sen-
tences
Sentences/
Paragraph
Words/
Sentence
Flesch
reading
Ease Level
Flesch-
Kincaid
Grade Level
A01 695 5 97 10 38 4.2 18.2 5.6 17.0
A02 885 5 100 18 52 3.0 16.5 0.0 17.5
A03 675 4 97 13 44 3.6 15.2 0.0 18.2
A04 752 4 98 9 39 4.8 19.2 0.0 19.1
A05 705 6 96 9 32 4.0 22.0 0.0 19.5
A06 726 5 95 11 37 3.7 19.5 2.9 17.7
A07 690 5 100 11 39 3.9 17.6 0.9 17.5
A08 766 4 98 13 43 3.5 17.7 5.2 16.9
A09 698 4 97 15 36 2.5 18.5 1.0 17.7
A10 762 6 94 12 44 4.0 17.2 7.4 16.5
A11 678 4 100 9 39 4.8 17.8 0.0 18.5
A12 646 5 99 9 30 3.7 21.3 0.0 19.2
B01 667 5 100 26 44 2.2 14.0 2.0 16.4
B02 766 5 100 29 39 2.6 18.1 0.0 17.9
B03 750 5 95 21 38 3.4 18.2 4.1 17.2
B04 677 5 100 23 38 3.4 16.6 8.2 16.2
B05 764 5 100 28 46 2.0 15.7 3.5 16.6
B06 933 2 97 26 44 2.3 19.4 4.4 17.4
B07 615 1 100 17 34 4.2 17.3 5.0 16.7
B08 723 4 96 12 37 3.3 19.2 0.0 18.9
B09 637 5 95 8 31 4.4 20.5 4.1 17.6
B10 658 5 97 19 33 2.5 19.1 0.0 17.9
B11 810 6 96 13 42 3.5 19.2 3.5 17.5
B12 601 5 97 8 34 4.8 17.6 0.2 17.6
C01 747 5 93 22 37 3.0 19.5 14.9 16.0
C02 713 5 100 10 34 3.7 20.9 0.0 19.1
C03 729 5 100 17 38 3.4 18.4 1.2 17.6
C04 627 5 96 7 29 4.8 21.5 0.0 18.9
C05 664 4 100 11 35 3.5 18.9 9.0 17.7
C06 641 5 97 13 33 2.7 19.0 6.8 16.8
C07 658 4 99 12 35 3.1 18.7 0.6 17.6
C08 735 5 95 10 36 4.0 20.3 0.5 18.2
C09 661 3 99 19 32 1.7 20.1 0.0 19.3
C10 727 8 92 10 38 4.2 19.1 0.0 18.5
C11 697 2 97 14 38 1.9 18.3 0.0 18.6
C12 713 4 96 8 37 5.2 19.2 0.0 18.1
Table A2. Coverage of values topics in the various iterations. ◊– mentioned as subset of another value term; •-prominently and explicitly mentioned.
Table A2. Coverage of values topics in the various iterations. ◊– mentioned as subset of another value term; •-prominently and explicitly mentioned.
Iteration Historic Value Scientific Value Social Value Aesthetic value Spiritual / Religious value Artistic value Educational value Economic value Tourism value Minority / Multicultural Values Environmental values Indigenous Values Individual/Personal values Community/ Collective Values Identify value Nostalgia / Emotional Value Tangible vs intangible values Cultural Value Heritage Value Instrumental value Utilitarian Value \use value Intrinsic value Extrinsic values Associative value Contextual / Relational value Universal values
A1
A2
A3
A4
A5
A6
A7
A8
A9
A10
A11
A12
B1
B2
B3
B4
B5
B6
B7
B8
B9
B10
B11
B12
C1
C2
C3
C4
C5
C6
C7
C8
C9
C10
C11
C12
Table A3. Coverage of value assessment topics in the various iterations. ◊– mentioned as subset of another value term; •- prominently and explicitly mentioned; B–Burra charter, N–Nara Charter, W-World Heritage Convention.
Table A3. Coverage of value assessment topics in the various iterations. ◊– mentioned as subset of another value term; •- prominently and explicitly mentioned; B–Burra charter, N–Nara Charter, W-World Heritage Convention.
Iteration Evolving societal perspectives Intergenerational mutability Subjectivity of values Cultural Relativism Eurocentrism Plurality of values
Multidimensionality of values
Value Hierarchies // Conflicts Global vs. Local Perspectives Community Perspectives Professional Perspectives Community Identity Contemporary significance Stakeholder Engagement Sustainable development Objective criteria Authenticity Integrity Ethical Considerations Ownership & Repatriation Heritage Significance ICOMOS Assessment frameworks
A1
A2
A3
A4
A5 B,N
A6
A7
A8
A9
A10
A11
A12
B1
B2
B3
B4 B,N
B5 x
B6 B,W
B7
B8 x
B9
B10
B11
B12
C1
C2
C3 W
C4
C5
C6
C7 W
C8
C9 B,N
C10
C11 B
C12 o B, N

Appendix B. Essay Structures

Table B1. Essay Structures Group 1, set A.
Table B1. Essay Structures Group 1, set A.
Essay C1 Essay C6 Essay C9 Essay A2 Essay B6
Defining values Defining values Defining values Multifaceted Nature of values Multifaceted Nature of values
Associative
Aesthetic
Historic
Scientific
Social
Historical
Aesthetic
Social & Cultural
Historic
Aesthetic
Social
Economic
Environ-mental
Historic
& Historical
Social & Community
Scientific & Research
Economic & Tourism
Historic
Artistic
Social
Scientific
Relativity of Values
Balancing conflicting values
Multiple Perspectives & Stakeholders
Cultural relativism & contextual understanding
Evolving values &Reassessment
Subjectivity & Multiple Perspectives
Indigenous & Local Perspectives
Global Perspectives
Ethical considerations
Ownership & Repatriation
Subjective Nature
Shifting societal Values
Stakeholder engagement
Ethical considerations
Challenges in Assessing
Value Hierarchies & Trade-offs
Lack of data & knowledge gaps
Global vs local perspectives
Subjectivity
Temporal Perspectives
Individual Interpretations
Challenges in Assessing
Conflicting values
Power imbalances
Global vs local dynamics
Incorporating values in Heritage Assessment
Participatory approaches
Table B2. Essay Structures Group 1, set B
Table B2. Essay Structures Group 1, set B
Essay A8 Essay B5 Essay A1 Essay B1 Essay A7 Essay C2 Essay B10
Subjectivity of heritage assessment
Aesthetic
Historic
Scientific
Social
Historic
Aesthetic
Social
Spiritual & Religious
Scientific
Historic
Artistic
Social
Historical
Cultural
Aesthetic
Social
Intrinsic
Historical
Aesthetic
Social
Spiritual & Religious
Scientific
Cultural, Historical and Aesthetic v.
Authenticity & Integrity
Social & Community v.
Educational & Interpretive v.
Economic and Touristic v.
Ethical & Intangible v.
Historical & Associative
Aesthetic
Social & community
Scientific & Research
Economic
Subjectivity
Cultural & Contextual Relativity
Shifting & Evolving Values
Subjectivity
Cultural relativism
Challenges in assessing values
Ethical considerations
Evolving values
Conflicting values
Subjectivity & Cultural relativism
Changing Values
Contemporary Significance
Challenges in assessing values
Economic
Decision Making Processes
Stakeholder Engagement
Sustainable Management
Cultural Diversity
Multicultural values
Challenges in assessing values
Inclusive & intergenerational perspectives
Table B3. Essay Structures Group 1, set C
Table B3. Essay Structures Group 1, set C
Essay A3 Essay A6 Essay B12
Intrinsic
Historical
Social
Environmental
Cultural
Historical
Social
Economic
Aesthetic
Historic
Artistic
Social
Scientific
Economic
Subjectivity & Context
Cultural Relativism
Community Engagement
Ethical consideration
Ownership & repatriation
Sustainability & Conservation
Challenges & Implications
Table B4. Essay Structures Group 2
Table B4. Essay Structures Group 2
A4 B2 B8 B11 C11 B4 A11
Intrinsic Intrinsic Intrinsic Intrinsic Intrinsic Intrinsic Intrinsic
Instrumental Instrumental Instrumental Instrumental Instrumental Contextual Contextual
Heritage Relational Process Contextual Associative Associative Instrumental
Associative
Cultural Relativism & values
Challenges & Controversies
Sources of Value
Cultural & Community Perspectives
Expert & Institutional Perspectives
Contemporary Contexts & Public Opinion
Challenges in assessing
Cultural Bias & Eurocentrism
Balancing Universal & Local Values
Ethical Considerations
Implications
Balancing Priorities
Cultural Diversity & Inclusivity
Sustainable Development
Ethical Considerations
Subjectivity
Stakeholder Perspectives
Local Communities
Government & Regulatory Bodies
Indigenous Groups
Multiple Perspectives
Experts& Professionals
Government & Policy Makers
Assessing Values
Burra Charter
Interpretation Charter *)
Cultural Perspectives
Stakeholder Engagement
Evolving nature of values
Role of legislation & international charters
Cultural Relativity & Subjectivity
Inclusive & holistic approaches
*) ICOMOS International Cultural Heritage Charter for the Interpretation and Presentation of Cultural Heritage Sites.
Table B5. Essay Structures Group 3
Table B5. Essay Structures Group 3
Essay A10 Essay B3 Essay C5 Essay C10 Essay B7 Essay A5 Essay A9 Essay C7
Defining Heritage Significance Defining Heritage Significance Defining Heritage Significance Defining Heritage Significance Cultural Significance Understanding Cult Her. v. Understanding Cult Her. v. Understanding Cult Her. v.
Subjectivity
Individual values
Collective values
Cultural Relativism
Significance Assessment frameworks
Implications and Challenges
Objective Criteria
Subjective v
Emotional Connections & Cultural Identity
Community Attachment & Collective Memory
Cultural Relativism
Balancing Subjectivity and Objectivity
Cultural Heritage Assessment
Universal values
Subjective values
Intangible Values
Multicultural Perspectives
Indigenous knowledge & values
Evolving values & Contemporary Significance
Intrinsic, Extrinsic & Contextual v.
Tangible & Intangible Heritage v.
Subjectivity & Multiple Perspectives
Stakeholder Engagement & Participatory Approaches
Ethical Considerations
Evolving & Dynamic Nature
Subjectivity & Diversity
Intangible v.
Social and economic v.
Ethical & Spiritual v.
Contemporary Relevance
Tangible & Intangible Heritage v
Significance Assessment Frameworks
Subjectivity& Cultural Relativity
Evolving Perspectives on v.
Challenges in Assessment & Conflicting v.
Intrinsic v.
Social v.
Utilitarian v.
Influences on v.
Cultural Relativism
Changing Societal v.
Economic Considerations
Challenges & Critiques
Subjectivity & Bias
Conflict of v.
Long-term Sustainability
Universal v.
Contextual v.
Cultural Significance Assessment
Value-based Approaches
Expert and Community Perspectives
Challenges & Considerations
Subjectivity & Biases
Evolving Nature of v.
Table B6. Essay Structures Group 4
Table B6. Essay Structures Group 4
Essay B9 Essay C4 Essay C8 Essay C12
Subjectivity of v. Subjectivity of v. Subjectivity of v. Subjectivity of v.
Diversity of v.Evolving Nature of v. Diversity of v. Tangible & Intangible v.
Cultural, Social & Identity v.
Historical & Educational v.
Economic & Touristic v.
Environmental & natural v.
Evolving & Dynamic Nature of v.
Contextuality of v.
Evolving Nature of v.
Multiple Dimensions of v.
References in Assessing v.
Cultural Heritage Legislation & Policies
Case Study
Role of Cultural Heritage v. in Preservation
Challenges in Assessing

Appendix C

Conversation between the author (DHRS) and ChatGPT regarding the origin of the references, 17 June 2023 at 14:35 AEST (4:35 GMT).

DHRS

Where did you get these references from?

ChatGPT

As an AI language model, my responses are generated based on a mixture of licensed data, data created by human trainers, and publicly available data. I have not been trained directly on specific books, articles, or databases, nor do I have access to proprietary academic databases.
The references provided in my previous responses were generated based on my understanding of the topic as a language model trained on a diverse range of text, including scientific literature, books, websites, and other textual sources. I aimed to provide a balanced and representative list of references on cultural values in cultural heritage management based on my training and knowledge. However, please note that the references I provide may not cover the entire breadth of the field, and it's always a good practice to consult additional sources and conduct your own research to ensure a comprehensive and up-to-date understanding of the topic.

DHRS

Did you source some of these references from Wikipedia?

ChatGPT

I apologize for any confusion caused. As an AI language model, my responses are generated based on a mixture of licensed data, data created by human trainers, and publicly available data. I do not have direct access to or knowledge of specific sources such as Wikipedia. I have been trained on a diverse range of data, including books, websites, and other texts, to generate responses based on patterns and information contained in the training data.
While I strive to provide accurate and up-to-date information, please note that my responses may not always reflect the most current research or developments in a particular field. Therefore, it's always a good idea to consult reputable sources, including academic literature, for specific references and information.

DHRS

who trained you?

ChatGPT

I was trained by a team of researchers and engineers at OpenAI. They curated and prepared a large dataset of text from the internet and other sources to train me using a machine learning technique called unsupervised learning. The training process involved exposing me to a wide variety of text, allowing me to learn the statistical patterns and relationships between words and sentences.
It's important to note that I don't have access to information about the specific individuals who contributed to my training, and I don't have direct knowledge of the sources or authors of the text in my training dataset.

Appendix D

Conversation between the author (DHRS) and ChatGPT regarding the genuineness of the references, 20 June 2023 at 09:11AEST (23:11 GMT).

DHRS

Write a 1500 word essay that discusses the nature of values used in the assessment of cultural heritage significance. Provide references

ChatGPT

[ generates an 818 word essay with five references ]

DHRS

Are all references that you have cited genuine references?

ChatGPT

I apologize for any confusion. As an AI language model, I don't have direct access to external sources such as databases or academic journals. The references I provided in the previous response were fictitious and were not based on genuine citations. They were included for illustrative purposes only. If you require genuine references for your essay, I recommend conducting research using reputable academic sources, databases, or libraries to find relevant and reliable information on the topic of cultural heritage significance.

DHRS

How do you create fictitious references?

ChatGPT

As an AI language model, I generate fictitious references by following a commonly used format for citing references. I typically provide the basic elements of a reference, such as author(s), publication year, title, and source, in a consistent style. However, please note that the references I generate are not based on actual sources and should not be considered as genuine citations.
When writing academic essays or research papers, it is important to use credible and reliable sources for references. You can consult academic databases, scholarly journals, books, and reputable websites to find relevant and accurate information. Properly citing your sources not only gives credit to the original authors but also allows readers to verify the information and build upon existing knowledge.

DHRS

Please explain your creation of fictitious references in more detail.

ChatGPT

I apologize for any confusion caused. As an AI language model, my responses are generated based on a mixture of licensed data, data created by human trainers, and publicly available data. I don't have direct access to external sources or the ability to browse the internet.
When providing fictitious references, I follow a common format used in academic writing to provide examples and demonstrate how references can be structured. However, please note that these references are not based on real sources and should not be used as citations in academic work.
To create fictitious references, I generate plausible combinations of author names, publication years, titles, and sources using the knowledge I have been trained on. These references are not linked to specific publications or databases. They are intended for illustrative purposes only and should not be considered as genuine citations.
If you are working on an academic project or require legitimate references, I recommend consulting reputable sources, such as academic journals, books, or databases, and following the appropriate citation style recommended by your institution or discipline.

DHRS

How do you determine what are plausible combinations of author names, publication years, titles?

ChatGPT

As an AI language model, I don't have access to a specific list of author names, publication years, or titles. Instead, I've been trained on a diverse range of text from the internet, including books, articles, websites, and other sources. During my training process, I learn patterns, language structures, and common conventions used in writing.
When generating fictitious references, I use the knowledge acquired during training to combine elements commonly found in academic references. For author names, I may generate combinations of common first and last names or use placeholders like "Author 1" and "Author 2" to represent multiple authors. Publication years can be randomly generated within a reasonable range, such as within the past few decades. Titles are often created by using general phrases or terms related to the topic being discussed.
It's important to note that while I can generate plausible combinations, these fictitious references should not be used as actual citations in academic work. When conducting research, it is always recommended to consult reliable and legitimate sources for accurate and appropriate references.

Appendix E

Conversation between the author (DHRS) and ChatGPT to assess ability to ‘self-reflect’ and incorporate these reflections into a new essay, 6 July 2023 at 11:05 (01:05 GMT).

DHRS

Write a 1500 word essay that discusses the nature of values used in the assessment of cultural heritage significance. Provide references.

ChatGPT

Title: The Nature of Values in Assessing Cultural Heritage Significance
Introduction: Cultural heritage encompasses the tangible and intangible elements that define a society's identity, reflecting its history, traditions, and values. The assessment of cultural heritage significance is crucial for its preservation and management. However, determining the value of cultural heritage involves a complex interplay of subjective and objective factors. This essay explores the nature of values used in the assessment of cultural heritage significance, highlighting the multidimensional and dynamic nature of these values.
  • Tangible and Intangible Values: Cultural heritage values can be broadly categorized as tangible and intangible. Tangible values refer to physical attributes such as architecture, artifacts, and landscapes, while intangible values encompass customs, rituals, languages, and knowledge systems. The assessment of significance must consider both aspects, recognizing that intangible values often imbue tangible heritage with deeper meaning.
  • Historical and Social Values: Historical values pertain to the significance of cultural heritage in relation to a society's past, encompassing its role in shaping history, historical events, and important figures. Social values, on the other hand, relate to the cultural heritage's role in fostering social cohesion, community identity, and inclusiveness. Evaluating these values requires an understanding of the historical context and societal dynamics that shape the heritage's significance.
  • Aesthetic and Artistic Values: Cultural heritage often possesses aesthetic and artistic values, reflecting the creativity and skill of its creators. These values can be found in various forms, such as architecture, sculptures, paintings, and traditional crafts. The assessment of aesthetic and artistic values involves considering elements such as form, design, craftsmanship, and the beauty or emotional impact conveyed by the heritage.
  • Symbolic and Spiritual Values: Cultural heritage can hold profound symbolic and spiritual meanings. Symbolic values are derived from the associations and representations linked to the heritage, such as national symbols or emblems of identity. Spiritual values, on the other hand, arise from the sacred or religious significance attached to certain sites, objects, or practices. Assessing these values necessitates understanding the cultural beliefs, narratives, and rituals connected to the heritage.
  • Environmental and Sustainable Values: Environmental values associated with cultural heritage emphasize its relationship with the natural environment. This includes landscapes, ecosystems, and biodiversity, as well as sustainable practices embedded in traditional knowledge systems. Recognizing the environmental impact and sustainable potential of cultural heritage is essential for balancing conservation efforts with the needs of contemporary society.
  • Economic and Tourism Values: In today's globalized world, cultural heritage often has economic significance, both locally and internationally. Economic values arise from tourism, cultural industries, and the potential for job creation and revenue generation. The assessment of economic values involves considering factors such as visitor numbers, economic impact studies, and sustainable development opportunities.
  • Community and Identity Values: Cultural heritage is deeply intertwined with community identity, serving as a source of pride, collective memory, and cultural continuity. Assessing community and identity values requires engaging with local communities, acknowledging their perspectives, and understanding the social, political, and economic factors that shape their relationship with the heritage.
Conclusion: The assessment of cultural heritage significance is a multidimensional and dynamic process that considers various values. From tangible and intangible elements to historical, social, aesthetic, symbolic, spiritual, environmental, economic, and community values, each dimension contributes to the overall significance of cultural heritage. Recognizing and balancing these values is crucial for effective conservation, management, and sustainable development of cultural heritage. By considering the diverse perspectives and voices involved, we can ensure the preservation of cultural heritage for future generations.
References:
  • UNESCO. (2016). Cultural Heritage. Retrieved from https://whc.unesco.org/en/culturaheritage/
  • Smith, L. (2006). Uses of Heritage. New York: Routledge.
  • Waterton, E., & Watson, S. (2015). Heritage and Community Engagement: Collaboration or Contestation? New York: Routledge.
  • Graham, B., & Howard, P. (Eds.). (2008). The Ashgate Research Companion to Heritage and Identity. New York: Routledge.
  • Pereira Roders, A., & Van Oers, R. (Eds.). (2017). Value in Heritage Management: Understanding Significance in Dynamic Contestations. Cham: Springer.
  • Meskell, L. (2005). Archaeological Heritage: Concepts, Issues, and Case Studies. Cambridge: Cambridge University Press.

DHRS

What are the shortcomings in the essay that you just wrote?

ChatGPT

Upon reviewing the essay, there are a few shortcomings that should be addressed:
  • Lack of In-text Citations: The essay lacks in-text citations to support the statements and arguments made throughout the text. Although references are provided at the end of the essay, it is essential to incorporate proper citations within the body of the essay to attribute specific ideas or information to their respective sources.
  • Limited Coverage of Perspectives: While the essay touches upon various dimensions of cultural heritage values, it could benefit from a more comprehensive exploration of diverse perspectives. For instance, it could delve deeper into the viewpoints of indigenous communities, marginalized groups, or postcolonial critiques to provide a more inclusive understanding of cultural heritage significance.
  • Absence of Contemporary Examples: The essay lacks specific and current examples to illustrate the discussed concepts. Integrating real-world case studies or examples would enhance the understanding of how values are assessed in the context of cultural heritage.
  • Insufficient Discussion on Balancing Conflicting Values: The essay briefly mentions the need to balance values, but it does not delve into the challenges or strategies involved in managing conflicting values. Exploring the complexities of decision-making when values clash would provide a more nuanced perspective on the topic.
  • Limited Discussion on the Dynamic Nature of Values: While the essay acknowledges the multidimensional nature of cultural heritage values, it does not extensively address the dynamic and evolving nature of these values over time. Understanding how values can change or be reinterpreted in different socio-cultural contexts would provide a more comprehensive analysis.
To enhance the essay, it is recommended to revise the content by addressing these shortcomings, incorporating in-text citations, providing more diverse perspectives, including contemporary examples, discussing the challenges of balancing values, and exploring the dynamic nature of cultural heritage values.

DHRS

Can you rewrite and improve your initial essay by incorporating the critique that you just wrote? Keep in mind that the word limit is 1500 words, so have more room to expand your discussion.

ChatGPT

Title: Assessing the Multidimensional Nature of Values in Cultural Heritage Significance
Introduction: Cultural heritage serves as a reflection of a society's history, traditions, and values, necessitating the assessment of its significance for preservation and management. However, evaluating the value of cultural heritage entails a complex interplay of subjective and objective factors. This essay aims to provide a comprehensive analysis of the nature of values used in assessing cultural heritage significance, addressing the critique of the previous essay and incorporating a broader range of perspectives and examples.
  • Tangible and Intangible Values: Cultural heritage values can be broadly categorized as tangible and intangible. Tangible values refer to physical attributes such as architecture, artifacts, and landscapes, while intangible values encompass customs, rituals, languages, and knowledge systems. Recognizing the inseparable connection between tangible and intangible elements allows for a more holistic understanding of cultural heritage significance.
  • Historical and Social Values: Assessing cultural heritage significance necessitates considering its historical and social values. Historical values pertain to the significance of cultural heritage in relation to a society's past, including its role in shaping history, historical events, and important figures. Social values, on the other hand, relate to the heritage's role in fostering social cohesion, community identity, and inclusiveness. Incorporating multiple perspectives and diverse historical narratives is crucial in uncovering the full historical and social significance of cultural heritage.
  • Aesthetic and Artistic Values: Cultural heritage often possesses aesthetic and artistic values, reflecting the creativity and skill of its creators. These values can be found in various forms, such as architecture, sculptures, paintings, and traditional crafts. Evaluating aesthetic and artistic values involves considering elements such as form, design, craftsmanship, and the emotional impact conveyed by the heritage. Incorporating contemporary examples, such as modern art installations, helps to highlight the dynamic nature of aesthetic values.
  • Symbolic and Spiritual Values: Cultural heritage holds symbolic and spiritual meanings for communities. Symbolic values derive from the associations and representations linked to the heritage, such as national symbols or emblems of identity. Spiritual values, in contrast, arise from the sacred or religious significance attached to certain sites, objects, or practices. Understanding the cultural beliefs, narratives, and rituals connected to the heritage allows for a deeper appreciation of its symbolic and spiritual values.
  • Environmental and Sustainable Values: Environmental values associated with cultural heritage emphasize its relationship with the natural environment. This includes landscapes, ecosystems, and biodiversity, as well as sustainable practices embedded in traditional knowledge systems. Recognizing the environmental impact and sustainable potential of cultural heritage is essential for balancing conservation efforts with the needs of contemporary society. Examining examples of heritage sites that promote sustainable practices would elucidate the environmental and sustainable values at play.
  • Economic and Tourism Values: Cultural heritage often carries economic significance, locally and internationally. Economic values arise from tourism, cultural industries, and the potential for job creation and revenue generation. However, assessing economic values should be done carefully, taking into account the potential negative impacts of over-commercialization and overtourism on the heritage itself and the surrounding communities. Incorporating case studies that explore sustainable tourism models can shed light on the complexities of economic and tourism values.
  • Community and Identity Values: Cultural heritage is deeply intertwined with community identity, serving as a source of pride, collective memory, and cultural continuity. Assessing community and identity values requires engaging with local communities, acknowledging their perspectives, and understanding the social, political, and economic factors that shape their relationship with the heritage. Empowering communities to participate in decision-making processes ensures that their voices and values are respected and preserved.
Conclusion: The assessment of cultural heritage significance involves a multidimensional and dynamic process that considers various values. Recognizing the interconnectedness of tangible and intangible values,historical and social values, aesthetic and artistic values, symbolic and spiritual values, environmental and sustainable values, economic and tourism values, and community and identity values is crucial for a comprehensive understanding of cultural heritage significance. By incorporating diverse perspectives, contemporary examples, and acknowledging the dynamic nature of values, we can ensure the preservation, management, and sustainable development of cultural heritage for future generations.
References: (References from previous response, with additional sources)
  • UNESCO. (2016). Cultural Heritage. Retrieved from https://whc.unesco.org/en/culturaheritage/
  • Smith, L. (2006). Uses of Heritage. New York: Routledge.
  • Waterton, E., & Watson, S. (2015). Heritage and Community Engagement: Collaboration or Contestation? New York: Routledge.
  • Graham, B., & Howard, P. (Eds.). (2008). The Ashgate Research Companion to Heritage and Identity. New York: Routledge.
  • Pereira Roders, A., & Van Oers, R. (Eds.). (2017). Value in Heritage Management: Understanding Significance in Dynamic Contestations. Cham: Springer.
  • Meskell, L. (2005). Archaeological Heritage: Concepts, Issues, and Case Studies. Cambridge: Cambridge University Press.
  • Harrison, R. (Ed.). (2013). Understanding the Politics of Heritage. Manchester: Manchester University Press.
  • Smith, L. (2017). The Uses of Heritage. New York: Routledge.
  • Bendix, R. F., Eggert, A., & Peselmann, A. (Eds.). (2012). Heritage Regimes and the State. Göttingen: Universitätsverlag Göttingen.
  • O'Donnell, S., & McCarthy, C. (Eds.). (2017). The Routledge Companion to Museum Ethics: Redefining Ethics for the Twenty-First-Century Museum. New York: Routledge.

References

  1. OpenAI. Introducing ChatGPT. Available online: https://openai.com/blog/chatgpt/ (accessed on 28 June 2023).
  2. Ray, P.P. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 2023. [Google Scholar]
  3. Chang, K.K.; Cramer, M.; Soni, S.; Bamman, D. Speak, memory: An archaeology of books known to chatgpt/gpt-4. arXiv preprint 2023, arXiv:2305.00118. [Google Scholar]
  4. Delacroix, S. Data Rivers: Re-balancing the data ecosystem that makes Generative AI possible (19 Jun 2023). SSRN 2023. [Google Scholar] [CrossRef]
  5. Liu, J.; Xia, C.S.; Wang, Y.; Zhang, L. Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation. arXiv preprint arXiv:2305.01210, 2023; arXiv:2305.01210 2023. [Google Scholar]
  6. Moons, P.; Van Bulck, L. ChatGPT: can artificial intelligence language models be of value for cardiovascular nurses and allied health professionals. European journal of cardiovascular nursing 2023. [Google Scholar] [CrossRef] [PubMed]
  7. Garrido-Merchán, E.C.; Arroyo-Barrigüete, J.L.; Gozalo-Brihuela, R. Simulating HP Lovecraft horror literature with the ChatGPT large language model. arXiv preprint arXiv:2305.03429, arXiv:2305.03429 2023.
  8. McGee, R.W. The Assassination of Hitler and Its Aftermath: A ChatGPT Short Story. Available at SSRN 4426338 2023. [Google Scholar]
  9. Landa-Blanco, M.; Flores, M.A.; Mercado, M. Human vs. AI Authorship: Does it Matter in Evaluating Creative Writing? A Pilot Study Using ChatGPT. 2023. [Google Scholar]
  10. Fitria, T.N. Artificial intelligence (AI) technology in OpenAI ChatGPT application: A review of ChatGPT in writing English essay. In Proceedings of the ELT Forum: Journal of English Language Teaching; 2023; pp. 44–58. [Google Scholar]
  11. Castro Nascimento, C.M.; Pimentel, A.S. Do Large Language Models Understand Chemistry? A Conversation with ChatGPT. Journal of Chemical Information and Modeling 2023, 63, 1649–1655. [Google Scholar] [CrossRef]
  12. Agapiou, A.; Lysandrou, V. Interacting with the Artificial Intelligence (AI) Language Model ChatGPT: A Synopsis of Earth Observation and Remote Sensing in Archaeology. Heritage 2023, 6, 4072–4085. [Google Scholar] [CrossRef]
  13. Neves, P.S. Chat GPT AIS “Interview” 1, December 2022. AIS-Architecture Image Studies 2022, 3, 58–67. [Google Scholar]
  14. Sng, G.G.R.; Tung, J.Y.M.; Lim, D.Y.Z.; Bee, Y.M. Potential and pitfalls of ChatGPT and natural-language artificial intelligence models for diabetes education. Diabetes Care 2023, 46, e103–e105. [Google Scholar] [CrossRef]
  15. King, M.R. The future of AI in medicine: a perspective from a Chatbot. Ann. Biomed. Eng. 2023, 51, 291–295. [Google Scholar] [CrossRef]
  16. Sarraju, A.; Bruemmer, D.; Van Iterson, E.; Cho, L.; Rodriguez, F.; Laffin, L. Appropriateness of Cardiovascular Disease Prevention Recommendations Obtained From a Popular Online Chat-Based Artificial Intelligence Model. JAMA 2023, 329, 842–844. [Google Scholar] [CrossRef] [PubMed]
  17. Bays, H.E.; Fitch, A.; Cuda, S.; Gonsahn-Bollie, S.; Rickey, E.; Hablutzel, J.; Coy, R.; Censani, M. Artificial intelligence and obesity management: An Obesity Medicine Association (OMA) Clinical Practice Statement (CPS) 2023. Obesity Pillars 2023, 6, 100065. [Google Scholar] [CrossRef]
  18. Grünebaum, A.; Chervenak, J.; Pollet, S.L.; Katz, A.; Chervenak, F.A. The exciting potential for ChatGPT in obstetrics and gynecology. Am. J. Obstet. Gynecol. 2023, 228, 696–705. [Google Scholar] [CrossRef] [PubMed]
  19. Rao, A.S.; Pang, M.; Kim, J.; Kamineni, M.; Lie, W.; Prasad, A.K.; Landman, A.; Dryer, K.; Succi, M.D. Assessing the utility of ChatGPT throughout the entire clinical workflow. medRxiv 2023, 2023.2002. 2021.23285886.
  20. Qi, X.; Zhu, Z.; Wu, B. The promise and peril of ChatGPT in geriatric nursing education: What We know and do not know. Aging and Health Research 2023, 3, 100136. [Google Scholar] [CrossRef]
  21. Biswas, S. Importance of chat GPT in Agriculture: According to chat GPT. Available at SSRN 4405391 2023. [Google Scholar] [CrossRef]
  22. Surameery, N.M.S.; Shakor, M.Y. Use chat gpt to solve programming bugs. International Journal of Information Technology & Computer Engineering (IJITC) ISSN: 2455-5290 2023, 3, 17–22. [Google Scholar]
  23. Haman, M.; Školník, M. Using ChatGPT to conduct a literature review. Accountability in Research 2023, 1–3. [Google Scholar] [CrossRef]
  24. Wang, S.; Scells, H.; Koopman, B.; Zuccon, G. Can ChatGPT write a good boolean query for systematic review literature search? arXiv preprint, 2023; arXiv:2302.03495. [Google Scholar]
  25. Jin, Q.; Leaman, R.; Lu, Z. Retrieve, Summarize, and Verify: How will ChatGPT impact information seeking from the medical literature? J. Am. Soc. Nephrol. 2023, 10.1681.
  26. McGee, R.W. Will ChatGPT Destroy the Accounting Profession? ChatGPT Replies. ChatGPT Replies (April 27, 2023), 2023. [Google Scholar]
  27. Lund, B.D.; Wang, T. Chatting about ChatGPT: how may AI and GPT impact academia and libraries? Library Hi Tech News 2023, 40, 26–29. [Google Scholar] [CrossRef]
  28. Corsello, A.; Santangelo, A. May Artificial Intelligence Influence Future Pediatric Research?—The Case of ChatGPT. Children 2023, 10. [Google Scholar] [CrossRef]
  29. Cascella, M.; Montomoli, J.; Bellini, V.; Bignami, E. Evaluating the feasibility of ChatGPT in healthcare: an analysis of multiple clinical and research scenarios. Journal of Medical Systems 2023, 47, 33. [Google Scholar] [CrossRef]
  30. Karakose, T.; Demirkol, M.; Yirci, R.; Polat, H.; Ozdemir, T.Y.; Tülübaş, T. A Conversation with ChatGPT about Digital Leadership and Technology Integration: Comparative Analysis Based on Human–AI Collaboration. Administrative Sciences 2023, 13. [Google Scholar] [CrossRef]
  31. Rathore, B. Future of textile: Sustainable manufacturing & prediction via chatgpt. Eduzone: International Peer Reviewed/Refereed Multidisciplinary Journal 2023, 12, 52–62. [Google Scholar]
  32. King, M.R.; chatGPT. A Conversation on Artificial Intelligence, Chatbots, and Plagiarism in Higher Education. Cellular and Molecular Bioengineering 2023, 16, 1–2. [Google Scholar] [CrossRef] [PubMed]
  33. He, Y.; Tang, H.; Wang, D.; Gu, S.; Ni, G.; Wu, H. Will ChatGPT/GPT-4 be a lighthouse to guide spinal surgeons? Ann. Biomed. Eng. 2023, 1–4. [Google Scholar] [CrossRef]
  34. Cheng, K.; Li, Z.; Li, C.; Xie, R.; Guo, Q.; He, Y.; Wu, H. The potential of GPT-4 as an AI-powered virtual assistant for surgeons specialized in joint arthroplasty. Ann. Biomed. Eng. 2023, 1–5. [Google Scholar] [CrossRef] [PubMed]
  35. Eggmann, F.; Weiger, R.; Zitzmann, N.U.; Blatz, M.B. Implications of large language models such as ChatGPT for dental medicine. Journal of Esthetic and Restorative Dentistry 2023. [Google Scholar] [CrossRef]
  36. Ollivier, M.; Pareek, A.; Dahmen, J.; Kayaalp, M.E.; Winkler, P.W.; Hirschmann, M.T.; Karlsson, J. A deeper dive into ChatGPT: history, use and future perspectives for orthopaedic research. Knee Surgery, Sports Traumatology, Arthroscopy 2023, 31, 1190–1192. [Google Scholar] [CrossRef]
  37. Gilson, A.; Safranek, C.W.; Huang, T.; Socrates, V.; Chi, L.; Taylor, R.A.; Chartash, D. How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR Med Educ 2023, 9, e45312. [Google Scholar] [CrossRef] [PubMed]
  38. Khan, R.A.; Jawaid, M.; Khan, A.R.; Sajjad, M. ChatGPT-Reshaping medical education and clinical management. Pakistan Journal of Medical Sciences 2023, 39, 605. [Google Scholar] [CrossRef]
  39. Lim, W.M.; Gunasekara, A.; Pallant, J.L.; Pallant, J.I.; Pechenkina, E. Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators. The International Journal of Management Education 2023, 21, 100790. [Google Scholar] [CrossRef]
  40. Rudolph, J.; Tan, S.; Tan, S. ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching 2023, 6. [Google Scholar]
  41. Qadir, J. Engineering education in the era of ChatGPT: Promise and pitfalls of generative AI for education. In Proceedings of the 2023 IEEE Global Engineering Education Conference (EDUCON); 2023; pp. 1–9. [Google Scholar]
  42. Yan, D. Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies 2023, 1–25. [Google Scholar] [CrossRef]
  43. Jeon, J.; Lee, S. Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT. Education and Information Technologies 2023, 1–20. [Google Scholar] [CrossRef]
  44. Sánchez-Ruiz, L.M.; Moll-López, S.; Nuñez-Pérez, A.; Moraño-Fernández, J.A.; Vega-Fleitas, E. ChatGPT Challenges Blended Learning Methodologies in Engineering Education: A Case Study in Mathematics. Applied Sciences 2023, 13. [Google Scholar] [CrossRef]
  45. Ali, K.; Barhom, N.; Marino, F.T.; Duggal, M. The Thrills and Chills of ChatGPT: Implications for Assessments in Undergraduate Dental Education. Preprints.org 2023, 2023020513. [Google Scholar] [CrossRef]
  46. Stokel-Walker, C. AI bot ChatGPT writes smart essays-should academics worry? Nature 2022. [Google Scholar] [CrossRef]
  47. Currie, G.; Singh, C.; Nelson, T.; Nabasenja, C.; Al-Hayek, Y.; Spuur, K. ChatGPT in medical imaging higher education. Radiography 2023, 29, 792–799. [Google Scholar] [CrossRef]
  48. Antaki, F.; Touma, S.; Milad, D.; El-Khoury, J.; Duval, R. Evaluating the Performance of ChatGPT in Ophthalmology: An Analysis of Its Successes and Shortcomings. Ophthalmology Science 2023, 3, 100324. [Google Scholar] [CrossRef]
  49. Choi, J.H.; Hickman, K.E.; Monahan, A.; Schwarcz, D. Chatgpt goes to law school. Available at SSRN 2023. [Google Scholar] [CrossRef]
  50. Salvagno, M.; Taccone, F.S.; Gerli, A.G. Can artificial intelligence help for scientific writing? Critical care 2023, 27, 1–5. [Google Scholar]
  51. Lund, B.D.; Wang, T.; Mannuru, N.R.; Nie, B.; Shimray, S.; Wang, Z. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. Journal of the Association for Information Science and Technology 2023, 74, 570–581. [Google Scholar] [CrossRef]
  52. Chen, T.-J. ChatGPT and other artificial intelligence applications speed up scientific writing. Journal of the Chinese Medical Association 2023, 86, 351–353. [Google Scholar] [CrossRef] [PubMed]
  53. Else, H. Abstracts written by ChatGPT fool scientists. Nature 2023, 613, 423–423. [Google Scholar] [CrossRef] [PubMed]
  54. Macdonald, C.; Adeloye, D.; Sheikh, A.; Rudan, I. Can ChatGPT draft a research article? An example of population-level vaccine effectiveness analysis. Journal of global health 2023, 13. [Google Scholar] [CrossRef]
  55. Biswas, S. ChatGPT and the future of medical writing. 2023, 307, e223312.
  56. Flanagin, A.; Bibbins-Domingo, K.; Berkwits, M.; Christiansen, S.L. Nonhuman “authors” and implications for the integrity of scientific publication and medical knowledge. Jama 2023, 329, 637–639. [Google Scholar] [CrossRef]
  57. Editorials, N. Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. Nature 2023, 613, 10–1038. [Google Scholar]
  58. Thorp, H.H. ChatGPT is fun, but not an author. 2023, 379, 313–313.
  59. Hill-Yardin, E.L.; Hutchinson, M.R.; Laycock, R.; Spencer, S.J. A Chat (GPT) about the future of scientific publishing. Brain Behav. Immun. 2023, 110, 152–154. [Google Scholar] [CrossRef]
  60. Malik, T.; Dwivedi, Y.; Kshetri, N.; Hughes, L.; Slade, E.L.; Jeyaraj, A.; Kar, A.K.; Baabdullah, A.M.; Koohang, A.; Raghavan, V. “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management 2023, 71, 102642. [Google Scholar]
  61. Gao, C.A.; Howard, F.M.; Markov, N.S.; Dyer, E.C.; Ramesh, S.; Luo, Y.; Pearson, A.T. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digital Medicine 2023, 6, 75. [Google Scholar] [CrossRef]
  62. Ventayen, R.J.M. OpenAI ChatGPT generated results: Similarity index of artificial intelligence-based contents. Available at SSRN 4332664 2023. [Google Scholar]
  63. Krishna, K.; Song, Y.; Karpinska, M.; Wieting, J.; Iyyer, M. Paraphrasing evades detectors of ai-generated text, but retrieval is an effective defense. arXiv preprint arXiv:2303.13408, 2023; arXiv:2303.13408 2023. [Google Scholar]
  64. Anderson, N.; Belavy, D.L.; Perle, S.M.; Hendricks, S.; Hespanhol, L.; Verhagen, E.; Memon, A.R. AI did not write this manuscript, or did it? Can we trick the AI text detector into generated texts? The potential future of ChatGPT and AI in Sports & Exercise Medicine manuscript generation. 2023, 9, e001568. [Google Scholar]
  65. Yurtsever, A. Documentation of cultural heritage with technology: Evaluation through some architectural documentation examples and brief looking at AI (Artificial Intelligence). Cultural Heritage and Science 4, 31-39.
  66. Hazan, S. The Dance of the Doppelgängers: AI and the cultural heritage community. In Proceedings of the Proceedings of EVA London, 10th–14th July 2023, 2023; pp. 77–84.
  67. Hazan, S. An Accident Waiting to Happen–Ai Besieges The Cultural Heritage Community. In Proceedings of the Electronic Visualisation for the Arts, 5 June 2023, Florence, 2023.
  68. Ciecko, B. 9 ways ChatGPT can empower museums & cultural organizations in the digital age. Cuseum Blog 2023, 2023. [Google Scholar]
  69. Frąckiewicz, M. ChatGPT in the World of Museum Technology: Enhancing Visitor Experiences and Digital Engagement. Available online: https://ts2.space/en/chatgpt-in-the-world-of-museum-technology-enhancing-visitor-experiences-and-digital-engagement/ (accessed on Jun 29, 2023).
  70. Lehmann, J. On the Use of ChatGPT in Cultural Heritage Institutions. Project “Human.Machine.Culture – Artificial Intelligence for the Digital Cultural Heritage 2023, 2023. [Google Scholar]
  71. Maas, C. Was kann ChatGPT für Kultureinrichtungen tun? Understanding AI 2023, 2023. [Google Scholar]
  72. Merritt, E. Chatting About Museums with ChatGPT. Center for the Future of Museums Blog 2023, 2023. [Google Scholar]
  73. Trichopoulos, G.; Konstantakis, M.; Caridakis, G.; Katifori, A.; Koukouli, M. Crafting a Museum Guide Using GPT4. Preprints.org 2023, 2023061618. [Google Scholar]
  74. Tranta, A.; Alexandri, E.; Kyprianos, K. Young people and museums in the time of covid-19. Museum Management and Curatorship 2021, 1–17. [Google Scholar] [CrossRef]
  75. Treleaven, E. Curating Historic Interiors at the Charles Dickens Museum during Covid. 19: Interdisciplinary Studies in the Long Nineteenth Century, 2021. [Google Scholar]
  76. Tserklevych, V.; Prokopenko, O.; Goncharova, O.; Horbenko, I.; Fedorenko, O.; Romaniuk, Y.S. Virtual Museum Space as the Innovative Tool for the Student Research Practice. 2021. 2021. [Google Scholar]
  77. Zollinger, R. Being for Somebody: Museum Inclusion During COVID-19. Art Education 2021, 74, 10–12. [Google Scholar] [CrossRef]
  78. Zolnowski, S.W. The Impact of the Covid-19 Pandemic on the American Museum Industry: A Historical Analysis, and an Inspection of Current Events, with a Look Towards the Future. State University of New York at Buffalo, 2021.
  79. Lobo, N. ChatGPT threatens academic honesty at museum. Available online: https://nycmuseumgallery.org/1791/news/chatgpt-threatens-academic-honesty-at-museum/ (accessed on Jun 29, 2023).
  80. Parker, M.; Spennemann, D.H.R. Classifying sound in the heritage environment. Acoust. Austr. 2021, 50, 23–39. [Google Scholar] [CrossRef]
  81. Smith, L. Uses of heritage; Routledge: Abingdon, 2006. [Google Scholar]
  82. UNESCO. Basic Texts of the 2003 Convention for the Safeguarding of Intangible Cultural Heritage’ for its protection and promotion; UNESCO: Paris, 2020. [Google Scholar]
  83. Howard, K. Music as intangible cultural heritage: Policy, ideology, and practice in the preservation of East Asian traditions; Routledge: 2016.
  84. Parker, M.; Spennemann, D.H.R. Stille Nacht: COVID and the ghost of Christmas 2020. Heritage 2021, 4, 3081–3097. [Google Scholar] [CrossRef]
  85. Feilden, B. Conservation of historic buildings; Routledge: 2007.
  86. Spennemann, D.H.R. Conservation management and mitigation of the impact of tropical cyclones on archaeological sites. In Disaster management programs for historic sites, Spennemann, D.H.R., Look, D.W., Eds.; Association for Preservation Technology, Western Chapter and Johnstone Centre, Charles Sturt University: San Francisco and Albury, NSW, 1998; pp. 113–132. [Google Scholar]
  87. Look, D.W.; Spennemann, D.H.R. In a tropical marine climate: Conservation Management of Historic Metals. APT Bulletin 1996, 27, 60–68. [Google Scholar] [CrossRef]
  88. Velthuis, K.; Spennemann, D.H.R. The future of Defunct Religious Buildings: Dutch Approaches to their Adaptive Reuse. Cultural Trends 2007, 16, 43–66. [Google Scholar] [CrossRef]
  89. Mısırlısoy, D.; Günçe, K. Adaptive reuse strategies for heritage buildings: A holistic approach. Sustainable cities and society 2016, 26, 91–98. [Google Scholar] [CrossRef]
  90. Bullen, P.A.; Love, P.E. The rhetoric of adaptive reuse or reality of demolition: Views from the field. Cities 2010, 27, 215–224. [Google Scholar] [CrossRef]
  91. Spennemann, D.H.R. Futurist rhetoric in U.S. historic preservation: A review of current practice. International Review on Public and Nonprofit Marketing 2007, 4, 91–99. [Google Scholar]
  92. Spennemann, D.H.R. The Futurist Stance of Historical Societies: An analysis of positioning statements. International Journal of Arts Management 2007, 9, 4–15. [Google Scholar]
  93. Spennemann, D.H.R. Beyond "Preserving the Past for the Future": Contemporary Relevance and Historic Preservation. CRM J. Heritage Steward. 2011, 8, 7–22. [Google Scholar]
  94. Spennemann, D.H.R. Conceptualizing a Methodology for Cultural Heritage Futures: Using Futurist Hindsight toMake ‘Known Unknowns’ Knowable. Heritage 2023, 6, 548–566. [Google Scholar] [CrossRef]
  95. Rea, A.; Munns Jr, W. The value of nature: Economic, intrinsic, or both? Integrated Environmental Assessment and Management 2017, 13. [Google Scholar] [CrossRef]
  96. Korostelina, K. Understanding values of cultural heritage within the framework of social identity conflicts. Values in heritage management. Emerging approaches and research directions 2019, 83–96. [Google Scholar]
  97. Seif, A. Conceiving the past: fluctuations in a multi-value system. Conservation and management of archaeological sites 2009, 11, 282–295. [Google Scholar] [CrossRef]
  98. Lockwood, M.; Spennemann, D.H.R. Value conflicts between natural and cultural heritage conservation - Australian experience and the contribution of economics. In Heritage economics: challenges for heritage conservation and sustainable development in the 21st Century; Australian Heritage Commission: Canberra, 2001; pp. 216–242. [Google Scholar]
  99. Fusco Girard, L.; Vecco, M. The “Intrinsic Value” of Cultural Heritage as Driver for Circular Human-Centered Adaptive Reuse. Sustainability 2021, 13. [Google Scholar] [CrossRef]
  100. U. S. Department of the Interior. The Secretary of the Interior's Standards for Rehabilitation and Guidelines for Rehabilitating Historic Buildings (36 CFR 67); Technical Preservation Services, National Park Service, U.S. Department of the Interior: Washington, DC, 2011. [Google Scholar]
  101. Australia ICOMOS. The Burra Charter. The Australia ICOMOS Charter for Places of Cultural Significance 2013; Australia ICOMOS Inc. International Council of Monuments and Sites: Burwood, Vic, 2013. [Google Scholar]
  102. Environment and Heritage Group. Assessing Heritage Significance. Guidelines for assessing places and objects against the Heritage Council of NSW criteria; Environment and Heritage Group, Department of Planning and Environment: Sydney, 2023; Volume 2. [Google Scholar]
  103. Historic England. Heritage Definitions. Definitions of terms used within heritage protection legislation and documents. Available online: https://historicengland.org.uk/advice/hpg/hpr-definitions/ (accessed on Apr 18, 2023).
  104. Historic England. Conservation Principles, Policies and Guidance for the Sustainable Management of the Historic Environment Historic Buildings and Monuments Commission for England: London, 2008.
  105. Pearson, M. , Sullivan, S. Looking after heritage places: the basics of heritage planning for managers, landowners and administrators; Melbourne University Press: Carton VIC, 1995. [Google Scholar]
  106. Spennemann, D.H.R. Your solution, their problem. Their solution, your problem: The Gordian Knot of Cultural Heritage Planning and Management at the Local Government Level. disP 2006, 42, 30–40. [Google Scholar] [CrossRef]
  107. Silberman, N. Changing visions of heritage value: What role should the experts play? Ethnologies 2014, 36, 433–445. [Google Scholar] [CrossRef]
  108. Hølleland, H.; Skrede, J. What’s wrong with heritage experts? An interdisciplinary discussion of experts and expertise in heritage studies. Int. J. Her. Stud. 2019, 25, 825–836. [Google Scholar] [CrossRef]
  109. Graham, K.; Spennemann, D.H.R. Heritage managers and their Attitudes towards Disaster Management for cultural heritage resources in New South Wales, Australia. International Journal of Emergency Management 2006, 3, 215–237. [Google Scholar] [CrossRef]
  110. Spennemann, D.H.R. The usefulness of the Johari Window for the Cultural Heritage Planning Process. Heritage 2023, 6, 724–741. [Google Scholar] [CrossRef]
  111. Eriksen, T.H. Between universalism and relativism: a critique of the UNESCO concept of culture. Culture and rights: Anthropological perspectives 2001, 127-148.
  112. Boas, F. Museums of ethnology and their classification. Science 1887, 612–614. [Google Scholar]
  113. Bennett, M.J. A developmental model of intercultural sensitivity. In The International Encyclopedia of Intercultural Communication, Yun, K.Y., Ed.; 2017; pp. 1–10.
  114. Brown, S. Mute or mutable? Archaeological significance, research and cultural heritage management in Australia. Australian Archaeology 2008, 67, 19–30. [Google Scholar] [CrossRef]
  115. Bowdler, S. Archaeology: Proceedings of the 1981 Springwood Conference on Australian Prehistory. In Site Surveys and Significance Assessment in Australian Archaeology; Department of Prehistory, Research School of Pacific Studies, Australian National University: Canberra, 1984; pp. 1–9. [Google Scholar]
  116. Spennemann, D.H.R. The Shifting Baseline Syndrome and Generational Amnesia in Heritage Studies. Heritage 2022, 5, 2007–2027. [Google Scholar] [CrossRef]
  117. Smith, L. Heritage, gender and identity. The Ashgate research companion to heritage and identity 2008, 159–178. [Google Scholar]
  118. Shortliffe, S.E. Gender and (world) heritage: the myth of a gender neutral heritage. World Heritage, Tourism and Identity. Inscription and Co-production. London, 2016; 107–120. [Google Scholar]
  119. Winter, T. Beyond Eurocentrism? Heritage conservation and the politics of difference. Int. J. Her. Stud. 2014, 20, 123–137. [Google Scholar] [CrossRef]
  120. Chung, S.-j.; Kim, C.-s. The Development of Attitudes to Historic Conservation: From Eurocentrism to Cultural Diversity. Architectural research 2010, 12, 25–32. [Google Scholar] [CrossRef]
  121. Brumann, C. Anthropological utopia, closet eurocentrism, and culture chaos in the UNESCO World Heritage Arena. Anthropological Quarterly 2018, 1203–1233. [Google Scholar] [CrossRef]
  122. Fredheim, L.H.; Khalaf, M. The significance of values: heritage value typologies re-examined. Int. J. Her. Stud. 2016, 22, 466–481. [Google Scholar] [CrossRef]
  123. Thompson, J.; Wijesuriya, G. From ‘Sustaining heritage’to ‘Heritage sustaining broader societal wellbeing and benefits’. World Heritage and Sustainable Development: New Directions in World Heritage Management, 2018. [Google Scholar]
  124. Spennemann, D.H.R. The Nexus between Cultural Heritage Management and the Mental Health of Urban Communities. Land 2022, 11, 1–11. [Google Scholar] [CrossRef]
  125. Maeer, G.; Fawcett, G.; Killick, T. Values and benefits of heritage. A research review. London: Heritage Lottery Fund, 2008. [Google Scholar]
  126. Gallou, E. Heritage and pathways to wellbeing: From personal to social benefits, between experience identity and capability shaping. Wellbeing, Space and Society 2022, 3, 100084. [Google Scholar] [CrossRef]
  127. Bendix, R. Culture and value: Tourism, heritage, and property; Indiana University Press: 2018.
  128. McKercher, B.; Du Cros, H. Cultural tourism: The partnership between tourism and cultural heritage management; Routledge: 2002.
  129. Timothy, D.J.; Boyd, S.W. Heritage tourism; Pearson Education: 2003.
  130. Kincaid, J.P.; Fishburne Jr, R.P.; Rogers, R.L.; Chissom, B.S. Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. Research Branch Report 8–75; Chief of Naval Technical Training: Naval Air Station Memphis, 1975. [Google Scholar]
  131. Hoke, B.L. Comparison of Recreational Reading Books Levels Using the Fry Readability Graph and the Flesch-Kincaid Grade Level. Kean University, Union, NJ, 1999.
  132. Miller, D. ESL reading textbooks vs. university textbooks: Are we giving our students the input they may need? Journal of English for Academic Purposes 2011, 10, 32–46. [Google Scholar] [CrossRef]
  133. Lahmar, O.; Piras, L. Making sense and transparency in finance literature: Evidence from trends in readability. Research in International Business and Finance 2023, 64, 101900. [Google Scholar] [CrossRef]
  134. Kumar, A.H. Analysis of ChatGPT tool to assess the potential of its utility for academic writing in biomedical domain. Biology, Engineering, Medicine and Science Reports 2023, 9, 24–30. [Google Scholar] [CrossRef]
  135. Davis, B.; Had to Ask Hal Foster for a Reality Check. A simple ChatGPT inquiry turned into a very strange ride. Available online: https://artandarchaeology.princeton.edu/whats/news/news-chatgpt-goes-rogue-fabricating-citations-hal-foster-and-carolyn-yerkes (accessed on Jun 23, 2023).
  136. Day, T. A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. The Professional Geographer 2023, 1–4. [Google Scholar] [CrossRef]
  137. Curtis, N. To ChatGPT or not to ChatGPT? The impact of artificial intelligence on academic publishing. The Pediatric Infectious Disease Journal 2023, 42, 275. [Google Scholar] [CrossRef] [PubMed]
  138. Masters, K. Medical Teacher’s first ChatGPT’s referencing hallucinations: Lessons for editors, reviewers, and teachers. Medical Teacher 2023, 1–3. [Google Scholar] [CrossRef] [PubMed]
  139. Rahman, M.M.; Terano, H.J.; Rahman, M.N.; Salamzadeh, A.; Rahaman, M.S. ChatGPT and academic research: a review and recommendations based on practical examples. Journal of Education, Management and Development Studies 2023, 3, 1–12. [Google Scholar] [CrossRef]
  140. BCP Council. Historic associative value. Available online: https://www.bcpcouncil.gov.uk/News/News-Features/Dorset-Local-Heritage-List/Nomination-Criteria/Historic-associative-value.aspx (accessed on Jun 29, 2023).
  141. Griffiths, M.; Lucas, J.; Griffiths, M.; Lucas, J. Economic Value and Intrinsic Value. Value Economics: The Ethical Implications of Value for New Economic Thinking, 2016; 143–174. [Google Scholar]
  142. Sandler, R. Intrinsic value. Ecology, and Conservation. Nature Educational Knowledge 2012, 3. [Google Scholar]
  143. Lombardi, L.G. Inherent Worth, Respect, and Rights. Environ. Ethics 1983, 5, 257–270. [Google Scholar] [CrossRef]
  144. Lowenthal, D. Natural and cultural heritage. Int. J. Her. Stud. 2005, 11, 81–92. [Google Scholar] [CrossRef]
  145. Harrison, R. Beyond “natural” and “cultural” heritage: Toward an ontological politics of heritage in the age of Anthropocene. Heritage & society 2015, 8, 24–42. [Google Scholar]
Figure 1. Frequency of word counts of essays excluding references (rounded to closest 25).
Figure 1. Frequency of word counts of essays excluding references (rounded to closest 25).
Preprints 78837 g001
Figure 2. Frequency of the number of references cited per iteration.
Figure 2. Frequency of the number of references cited per iteration.
Preprints 78837 g002
Table 1. General statistics of the documents analyzed in this paper.
Table 1. General statistics of the documents analyzed in this paper.
Word Count of Text Flesch-Kincaid Grade Level
Run Set Avg±StdDev Min–Max Avg±StdDev Min–Max
A 723.17±62.92 646–885 17.94±0.97 16.50–19.50
B 716.75±94.81 601–933 17.33±0.76 16.20–18.90
C 692.67±40.56 627–747 18.03±0.96 16.00–19.30
Table 2. Nature of the references cited in the documents analyzed in this.
Table 2. Nature of the references cited in the documents analyzed in this.
Run Set
Reference A B C
exists 40.0 52.8 56.4
exists, but wrong year 13.3 20.8 12.7
exists, but wrong URL 3.3 3.6
exists, but wrong year and URL 3.3 3.6
fictitious (constructed) 40.0 26.4 23.6
n 60 53 55
Table 3. Coverage of value descriptors in the various iterations..
Table 3. Coverage of value descriptors in the various iterations..
Concept A B C Overall
Historic Value 83.3 91.7 66.7 80.6
Social Value 83.3 83.3 66.7 77.8
Aesthetic value 58.3 83.3 41.7 61.1
Scientific Value 58.3 75.0 25.0 52.8
Economic value 33.3 58.3 33.3 41.7
Intrinsic value 41.7 41.7 16.7 33.3
Spiritual / Religious value 25.0 41.7 25.0 30.6
Tangible vs intangible values 16.7 16.7 41.7 25.0
Minority / Multicultural Values 33.3 16.7 8.3 19.4
Contextual / Relational value 8.3 33.3 16.7 19.4
Artistic value 16.7 25.0 8.3 16.7
Tourism value 8.3 16.7 25.0 16.7
Cultural Value 16.7 8.3 25.0 16.7
Associative value 8.3 25.0 16.7 16.7
Educational value 16.7 8.3 16.7 13.9
Community/ Collective Values 25.0 16.7 13.9
Instrumental value 8.3 25.0 8.3 13.9
Environmental values 16.7 16.7 11.1
Individual/Personal values 25.0 8.3 11.1
Indigenous Values 8.3 8.3 8.3 8.3
Utilitarian Value \use value 16.7 8.3 8.3
Universal values 16.7 5.6
Identify value 8.3 2.8
Nostalgia / Emotional Value 8.3 2.8
Heritage Value 8.3 2.8
Extrinsic values 8.3 2.8
n 12 12 12 36
Value Hierarchies / Conflicts 27.8 41.7 19.4 19.4
Table 4. Coverage of value assessment concepts in the various iterations.
Table 4. Coverage of value assessment concepts in the various iterations.
Concept A B C Overall
Subjectivity of values 83.3 50.0 66.7 66.7
Evolving societal perspectives 50.0 58.3 50.0 52.8
Stakeholder Engagement 50.0 50.0 50.0 50.0
Cultural Relativism 75.0 33.3 33.3 47.2
Value Hierarchies // Conflicts 58.3 33.3 25.0 38.9
Authenticity 41.7 16.7 33.3 30.6
Heritage Significance 25.0 33.3 25.0 27.8
Ethical Considerations 25.0 25.0 25.0 25.0
Assessment frameworks 16.7 16.7 41.7 25.0
ICOMOS 16.7 8.3 41.7 22.2
Community Perspectives 33.3 25.0 19.4
Intergenerational mutability 16.7 33.3 16.7
Multidimensionality of values 8.3 25.0 16.7 16.7
Community Identity 25.0 16.7 8.3 16.7
Ownership & Repatriation 8.3 16.7 16.7 13.9
Plurality of values 8.3 8.3 16.7 11.1
Global vs. Local Perspectives 8.3 16.7 8.3 11.1
Professional Perspectives 16.7 16.7 11.1
Integrity 8.3 8.3 16.7 11.1
Contemporary significance 16.7 8.3 8.3
Sustainable development 16.7 8.3 8.3
Eurocentrism 8.3 2.8
Objective criteria 8.3 2.8
n 12 12 12 36
Table 5. Correlation of the inclusion of values of the authorized heritage discourse against concepts for assessing values (n=36).
Table 5. Correlation of the inclusion of values of the authorized heritage discourse against concepts for assessing values (n=36).
Value
Historic Social Aesthetic Scientific
Subjectivity of values 52.8 52.8 41.7 33.3
Evolving societal perspectives 38.9 38.9 30.6 30.6
Stakeholder Engagement 36.1 36.1 30.6 22.2
Cultural Relativism 36.1 36.1 33.3 30.6
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

© 2024 MDPI (Basel, Switzerland) unless otherwise stated