1. Introduction
In the advanced information and communications network society of recent years, there is an abundance of a wide variety of information on the internet, and anyone can easily obtain the information they need [
1,
2]. With the rise of various social media platforms, as anyone can become both a sender and a recipient, the information inundation on the internet has accelerated [
3,
4,
5,
6,
7]. This also applies to sightseeing information, as there has been an increase in the use of the internet as a method to easily and effectively obtain various information [
8]. Additionally, online reviews on tourism-related web media are seen as an important source of sightseeing information. However, tourists must appropriately sift through the information to find what they need. Tourists who are not familiar with the tourist destinations may find it hard to obtain necessary information and use this to create a satisfactory sightseeing plan that tours various sightseeing spots [
9,
10].
Regarding tourism, it is important that both static information such as the preferences of tourists and opening hours of sightseeing spots as well as dynamic information such as the congestion of tourist destinations and temporary events are efficiently used to create a suitable tourism plan. However, collecting, accumulating and managing dynamic information can cost tourists time, money and energy. Based on the above, a system that can provide support for the collection and systemization of various information and activity simulation before travelling as well as the efficient collection of necessary information while traveling is essential. Additionally, according to the survey on travel intentions after COVID-19 pandemic conducted by the Japan Travel Bureau Foundation (2022), there were many comments saying they wish to travel more frequently after COVID-19 pandemic, and that it is important to avoid congestion while traveling [
11]. Therefore, a system that visualizes and provides the information concerning the situations of sightseeing spots in real time is also necessary.
The present study aims to take the above academic and social background into consideration in order to integrate an original tourism planning support system with the web-geographic information systems (Web-GIS) to develop a system that provide tourism supports specifically for tourists who are not familiar with the tourist destinations. Moreover, two original functions are implemented in this system. One is the function to efficiently collect and update both static and dynamic information in real time from tourism-related web media as well as social media. The other is the function to visualize and display such information in a virtual reality (VR) space which was developed using the three dimension (3D) city model of the tourist destinations.
The area of Osaka City in Japan was selected as the operation target for the system. The first reason why Osaka City was selected is that it is an urban tourist destination with a concentration of many famous sightseeing spots, and many sightseeing plans can be created according to the purpose of travel. The second reason is that many attractive sightseeing spots are concentrated in several specific districts within Osaka City, and it is difficult for tourists to comprehensively grasp the information they require. Additionally, the third reason is that there are many submissions concerning sightseeing spots in Osaka City on social media.
2. Related Work
As mentioned in
Section 1, the present study develops a unique system by integrating multiple systems such as a tourism planning support system and Web-GIS. Therefore, considering the system characteristics, the present study is related to four study fields, including (1) studies related to tourism planning support systems using Web-GIS, (2) studies related to tourism support systems using VR technology, (3) studies related to information sharing systems, and (4) studies related to systems utilizing social media.
Regarding (1) studies related to tourism planning support systems using Web-GIS, Kurata (2012), Kurata et al. (2015), Zhuang et al. (2015), García-Palomares et al. (2015), Sugimoto (2018), Kaufmann et al. (2018) and Hirota et al. (2019) created tourism potential maps that displayed areas with high tourism potential on the digital maps of Web-GIS, quantifying tourist destination highlights by using data extracted from photo-sharing sites and social media [
12,
13,
14,
15,
16,
17,
18]. Fajuyigbe et al. (2007), Chang et al. (2011), Singh et al. (2011), Masron et al. (2015, 2016), Bali et al. (2016), Itou et al. (2018) Ikizawa-Naitou et al. (2020) and Koga et al. (2021) developed tourism support systems that displayed various information concerning tourist attractions and routes on the digital maps of Web-GIS [
9,
19,
20,
21,
22,
23,
24,
25,
26]. In this academic field, it was revealed the necessity of having administrators update the information concerning the operation target area, as users could not plan to visit sightseeing spots that had not been saved to the databases of the systems.
Regarding (2) studies related to tourism support systems using VR technology, Guttentag (2010), Tan et al. (2012), Noguera et al. (2012), Chiao et al. (2018), Beck et a. (2019), Poux et al. (2020), Hou et al. (2021), and Putra et al. (2021) developed tourism simulation systems based on VR technology that met the needs of visit to various sightseeing spots in tourist destinations in the VR spaces [
27,
28,
29,
30,
31,
32,
33,
34]. Aziz et al. (2014), Bruno et al. (2016), Gretzel et al. (2016), Nayyar et al. (2018), Makino et al. (2019) and Bec et al. (2021) integrated VR, Augmented Reality (AR) and mixed reality (MR) to develop original systems that visualized spatiotemporal information related to sightseeing spots including world heritage sites and guided users to points of their interests in tourist destinations in the VR spaces [
35,
36,
37,
38,
39,
40]. In this academic field, as the studies developed original 3D models, the development of the systems took a very high cost. The system of Hou et al. (2021) had a low review for the system trial, as it must be used with the head mounted display (HMD) which caused users to feel dizzy. Additionally, this system could not collect information. The system of Noguera et al. (2012) did not use the 3D digital map and the 3D model, and only displayed satellite images, and land uplifts based on elevation as well as the longitude and latitude.
Regarding (3) studies related to information sharing systems, Go et al. (2005), Kanekiyo et al. (2008), Horikawa et al. (2012), Yanagisawa et al. (2012), Nakahara et al. (2013) and Kojima et al. (2014) developed information sharing GIS that integrated Web-GIS, Wiki and social network services (SNS) to accumulate local knowledge of the local communities [
41,
42,
43,
44,
45,
46]. Okazaki et al. (2013), Okuma et al. (2013), Murakoshi et al. (2014), Yamamoto et al. (2015) and Shibata et al. (2018) developed disaster information sharing systems that could be used during normal times as well as when a disaster occurs [
47,
48,
49,
50,
51]. Ueda et al. (2015), Ohoka et al. (2015) and Kunieda et al. (2019) produced post-sightseeing information from the activities of tourists when sightseeing, and developed systems that could share such information with other users as pre-sightseeing information [
52,
53,
54]. In this academic field, the systems enabled users to share limited information. Specifically, while the system of Ueda et al. (2015) allowed users to register and share sightseeing spots, travel routes to that destination and the related images, it did not have the SNS function to leave reviews and any functions that supported the online preview of tourist destinations.
Regarding (4) studies related to systems utilizing social media, Yamada et al. (2013), Ishino (2014), Yang et al. (2015) Yamamoto et al. (2017), Yoon et al. (2018), Yamamoto et al. (2021) and Yamada et al. (2022) developed automatic web-based real time service systems that extracted necessary information from submissions on social media and transmited it to users. [
55,
56,
57,
58,
59,
60,
61]. Kusmawan et al. (2014), Sato et a. (2015), Kwak et al. (2016), Kawai et al. (2018), Tran et al. (2022), Fujihara (2020) utilized location-based SNS to develop original systems that predicted and visualized the congestion for any location and area specified by users [
62,
63,
64,
65,
66,
67]. In this academic field, though the systems collected information concerning tourist destinations from social media, these did not support tourism planning. Additionally, in most of the system, the number of submissions was low.
In addition to overcoming the issues of the previous studies as introduced above, the present study demonstrates the originality in developing a unique system that makes the following three elements possible. The first element of the originality is that the system can provide the continuous and flexible tourism supports by extracting social media information, having users update the database to produce dynamic information, and using the information as a reference. The second element of originality is that the system can be developed and operated at low cost by effectively using the static and dynamic data and information collected from open data in addition to tourism-related web media and social media. The third originality is that the system enables users to have unique experiences of walking through a tourist destination in the VR space by adopting VR technology.
3. System Design
3.1. System Characteristics
As shown in
Figure 1, the system in the present study is made up of an original tourism planning support system and Web-GIS. Additionally, by efficiently collecting information from tourism-related web media and social media, the system can continuously provide information and estimate popular sightseeing spots. The collected information is saved to the database and can be viewed by users.
Furthermore, according to the survey result of Sakiyama et al. (2022), a unique sense of scale, tours through the city in the VR space, efficient previews of tourist destinations, and recollections of travel experiences were a few possibilities for the VR travel content [
68]. Additionally, dizziness caused by VR as well as the insufficient replication of the real cityscape were raised as issues. As a solution to these issues, the present study will develop an online VR space without using HMD, and prepare an interface that can switch between the 2D and 3D digital maps. By doing so, users can have a pleasant experience when using the system. Additionally, the dynamic sightseeing information can be collected and saved to the database, and this information can be superimposed and displayed on the 2D and 3D digital maps.
3.2. Target Devices
Though it is assumed that this system will be mostly used on PCs or mobile information terminals, there is no difference between devices used, and both types of devices can use the same functions. PC users are assumed to be mainly indoors, and will use the system to collect sightseeing information to supplement their travel activities, and evaluate sightseeing spots that have already been registered in the system. On the other hand, mobile information terminal users are assumed to be both indoors and outdoors, and will use the system to collect sightseeing information to supplement their travel activities, submit new sightseeing spot information, and evaluate sightseeing spots that have already been registered in the system.
3.3. System Operating Environment
This system operates using a Web server, database server, and GIS server.
Figure 2 shows the system operating environment. Heroku, which was adopted for both the Web server and database server, is a PaaS provided by the Salesforce, Inc. ArcGIS Online provided by the Environmental Systems Research Institute, Inc. (ESRI) was adopted for the GIS server. Web applications developed in the system has PHP, JavaScript, and HTML as the main language, and Laravel of the PHP framework was adopted for the implementation.
3.4. Design of Each System
3.4.1. Tourism Planning Support System
An original tourism planning support system is integrated into the system of the present study in order to lessen the burden of users when collecting sightseeing information. This system is implemented with the functions of new user registration and login, sightseeing plan and record creation, sightseeing spot information viewing, sightseeing plan and record sharing, and my page.
3.4.2. Web-GIS
The system of the present study adopts the ArcGIS API for JavaScript of Web-GIS provided by the ESRI. This does not require users to install any special software and allows them to use the system on a web browser as well as visualizes route searches and information on the 2D and 3D digital maps. Regarding the digital map adopted with Web-GIS, the 2D digital map provided by the Geospatial Information Authority of Japan is adopted. Additionally, this is overlaid with the 3D city model provided by the project PLATEAU of the Ministry of Land, Infrastructure, Transport and Tourism (MLIT) to develop and adopt a 3D digital map. The above 2D digital map and 3D city model are open data. The Web-GIS is implemented with the function of virtual city walk experience.
3.4.3. Social Media
In order to support the production of high-quality sightseeing plans, the system collects dynamic tourism-related information from social media. The social media platforms used as information sources are Twitter, Flickr as well as YouTube. Additionally, real time information is collected using each API, and is superimposed and displayed on the 2D and 3D digital maps. Regarding Twitter, the names of the sightseeing spots are searched using the Twitter Search API provided by the X Corp., and the information excluding sensitive submissions and retweets are saved to the database. For Flickr, Flickr API provided by the SmugMug, Inc. is used, and submissions related to sightseeing spots are obtained and saved to the database. Regarding YouTube, YouTube Data API provided by the Google LLC is used, and the top 10 most played videos related to sightseeing spots are obtained and saved to the database. As the system automatically conducts the data search and save process daily, users can obtain sightseeing spot information on social media in real time.
4. System Development
4.1. System Frontend
The present study will implement original functions of this system designed for users as described in detail below.
- (1)
Function of new user registration and login
When users use the system for the first time, they will register their email addresses and passwords on the page for the function of new user registration. After the second time, users can enter their email addresses and passwords on the page for the function of login.
- (2)
Function of sightseeing plan and record creation
Figure 3 shows the page for the function of sightseeing plan and record creation. As shown in
Figure 3, several sightseeing spots on the digital map of Web-GIS are selected, and sightseeing plan and record are created. By means of this function, a list of sightseeing spots that were previously registered to the database of the system is displayed, users can register new sightseeing spots as well as save the information to the database. Pop-ups of sightseeing spot information can be displayed by clicking or tapping on the icon located on the digital map. By registering new sightseeing spot information (name, notes, travel time, images and social media information) to the pop-ups, users can create sightseeing plans.
Figure 4 shows the process of sightseeing plan and record creation. After adding sightseeing spots and clicking or tapping on the “save” button, users will be redirected to a page where they can enter the date, title and description of their sightseeing plans and records. The sightseeing plan is completed when users click or tap on the “register” button on this page.
Figure 5 shows the page for the registration of new sightseeing spots. In order to register new sightseeing spots and save the information to the database, users have to click or tap on the “add a new spot” button on the top of the digital map which will take them to the page for the registration of new sightseeing spots (
Figure 5). On this page, users will enter the “sightseeing spot name” and select a “category” in addition to the address and website. Categories include “notable and historical site”, “park and botanical garden”, “public facilities”, “drinking and eating establishment”, “temple and shrine”, “art museum and museum”, “hot springs”, “cherry-blossom viewing”, “festival and event”, “theme park”, and “other”.
- (3)
Function of sightseeing spot information viewing
The sightseeing spot information saved to the database of the system can be viewed.
Figure 6 shows the page for the details of sightseeing spot. The page with the list of sightseeing spots displays the name, the images, the category, the number of Twitter submissions as well as the number of Flickr submissions for each sightseeing spot. The images of the sightseeing spots are either taken from Flickr or the database of the system. Additionally, by clicking or tapping on the name of each sightseeing spot, users will be moved to the page for the details of sightseeing spot (
Figure 6). On this page, basic information concerning sightseeing spots, information taken from social media and the location on the 2D digital map will be displayed. Pop-up contains the name, note, travel time, image, address, website and social media information of the selected sightseeing spot.
- (4)
Function of sightseeing plan and record sharing
Figure 7 shows the page for the function of sightseeing plan and record sharing, and
Figure 8 shows the page for the details of sightseeing plan and record. Users can submit and share their sightseeing plan and record after adding their reviews and comments on the sightseeing spots they have traveled to with other users. Additionally, users can evaluate travel plans and records created by other users by using the “like” button. Users can click or tap on the “SNS” in the navigation bar on the top of the screen to move to the page for the function of sightseeing plan and record sharing. On this page, information concerning sightseeing plan and record including the “user name”, “sightseeing plan and record”, “date of registration”, “title”, “overview of the sightseeing plan and record”, “added images”, “the “like” button”, and the “number of “likes” it has received” are displayed.
By clicking or tapping on the box of each sightseeing plan and record or the “details” button, users will be moved to the page for the details of sightseeing plan and record (
Figure 8). On this page, users can view the sightseeing plans on the 2D and 3D digital maps. Additionally, this page also shows the submitted time and title of the sightseeing plan and record, a description, a timeline of the sightseeing spots, the shortest route on the 2D and 3D digital maps as well as a list of nearby sightseeing spots. The function of virtual city walk experience introduced in the next section can be used from this page.
- (5)
Function of virtual city walk experience
Figure 9 shows the page for the function of virtual city walk experience. By selecting the “3D map” tab on each sightseeing plan and record on this page, users can use this function. Additionally, they can shift the perspective or change the lighting by clicking or tapping on the button on the 3D digital map.
- (6)
Function of my page
Users can be moved to the page for the function of my page by clicking or tapping on the user name at the top of the screen and selecting “Mypage”. On this page, users can view the sightseeing plans and records that they have made as well as a list of sightseeing plan and record they have “liked”.
4.2. System Backend
The following processes are handled by the system backend.
- (1)
The processing for the function of new user registration and login
New user information is saved to the Heroku database. Passwords are hashed using the function of PHP Hash and saved in the database. When logging in, the password hashing is conducted and the login is processed, if the ID and password within the database are matched. If there is no match, an error message will be displayed and the login information must be reentered.
- (2)
The processing for the function of sightseeing plan and record creation
The process of saving the information submitted using the function of sightseeing plan and record creation to the database is conducted. In the database, there will be two tables for the information concerning sightseeing plan and record as well as the sightseeing spots are created and save.
- (3)
The processing for the function of sightseeing plan and record sharing
The processing includes displaying the sightseeing plan and record saved in the database in chronological order on the screen, and evaluating by means of the “like” button.
- (4)
The processing for the function of virtual city walk experience
In order to implement each button for the function of virtual city walk experience, the user perspective is updated using the functions of ArcGIS for JavaScript.
- (5)
The processing for the display of social media information
The location information from the submissions on each social media platform in addition to information related to sightseeing spots in texts are extracted and saved to the database. Additionally, information is integrated into each sightseeing spot within the database and is displayed on the 2D map of Web-GIS.
- (6)
Derivation of the shortest routes between sightseeing spots
Using the road database provided by the Network Analysis Service of ArcGIS, the shortest route between sightseeing spots are derived.
4.3. System Interface
There are two types of interfaces in this system. One is the screen for PC and mobile information terminals of users, and the other is the screen for PC of administrators. In this way, a responsive screen is adopted into the system, and two types of interfaces are used according to the screen size of the devices used. With the page for administrators, users, registered sightseeing spot information as well as submitted information can be managed. By adopting graphical user interface (GUI), users with malicious intent and inappropriate sightseeing spot information can be deleted without the influence of the information technology (IT) literacy of the administrators.
5. System Operation
5.1. Sightseeing Spot Ddata
In order to make the functions of the system available for use immediately after the start of the operation, sightseeing spot information must be collected and registered to the database beforehand. Information concerning a total of 529 sightseeing spots in the operation target area (Osaka City) was collected from tourism-related web media such as 4travel.jp, Jalen.net and TripAdvisor. These sightseeing spots were divided into the 10 categories introduced in the
Section 4.1.
5.2. Operation Result
The operation of this system was conducted on people both within and outside the operation target area over a one-month period from December 21st, 2022 to January 24th, 2023. The system use was advertised on the website, and Twitter and Facebook accounts of the authors’ lab. The total number of users was 56, which included 36 men, 18 women and 2 others. 48% of users were in their 20s which was the highest percentage. 13% were in their 30s, 11% were under 20, 11% were in their 40s as well as over 60, and 7% were in their 50s respectively. Though the majority of users are a younger generation, it is used by a wide range of age groups. Additionally, during the operation period of the system, users registered 10 sightseeing plans and one travel record, and submitted seven sightseeing spot information. However, if the system were operated for a longer period of time, there would be a high potential for more multifaceted use.
6. System Evaluation
After the operation, an online questionnaire survey towards users as well as an access log analysis were conducted to evaluate the system. All users responded to the questionnaire survey.
6.1. Evaluations Based on the Questionnaire Survey
6.1.1. Overview of an Online Questionnaire Survey
In line with the purpose of the present study, an online questionnaire survey towards users was conducted to evaluate (1) the main functions and (2) the system as a whole. The questionnaire survey was conducted one week after the start of the operation. Regarding the number of visits to the operation target area, 27% responded “never”, “once”, or “2~5 times” respectively, 7% responded “6~9 times”, 10% responded “10 times or more”, and 1% responded “I am living here” and “I used to live there” respectively. Therefore, it was revealed that the system was mainly used by people living outside Osaka City. With the focus on the number of visits to Osaka City, users who answered “0~1 time” are considered to have little travel experience, and users who answered “2 or more times” are considered to have travel experience.
6.1.2. Evaluation of the Main Functions
In this section, the main functions of the system are evaluated.
Table 1,
Table 2,
Table 3,
Table 4,
Table 5,
Table 6,
Table 7 and
Table 8 show the cross-tabulation tables of each evaluation item for the main functions and users’ travel experiences to the operation target area. Whether or not the travel experience to the operation target area causes bias in evaluations is confirmed by conducting the Pearson's chi-square test for these tables.
- (1)
Function of sightseeing plan and record creation
Regarding the usefulness of the function of sightseeing plan and record creation, 93% of users very highly rated this function as they responded with “strongly agree” and “agree”. As a result of the chi-square test for
Table 1, there was no bias in the evaluations caused by the different travel experiences to the operation target area (
). Therefore, regardless of users’ travel experiences to the operation target area, the function was designed to be easy to use.
Regarding the appropriateness of the function of sightseeing plan and record creation, 88% highly rated this function as they responded with “strongly agree” or “agree”. However, as a result of the chi-square test for
Table 2, it showed that there were negative evaluations from users who had travel experiences to the operation target area (
). Regarding the reasons for this, as some users wrote “the system was slow” and “it took time for the pages to be displayed” in the comments section. Therefore, it was revealed that some users who had travel experiences to the target area felt that the function was hard to use, as it was slow when using it on their smartphones.
- (2)
Function of sightseeing spot information viewing
Regarding the usefulness of the function of sightseeing spot information viewing, 95% very highly rated this function as they responded with “strongly agree” or “agree”. As a result of the chi-square test for
Table 3, there was no bias in the evaluations caused by the different travel experiences to the operation target area (
). Therefore, this shows that the function greatly contributed to the collecting of new sightseeing information, as it produced and provided dynamic information in real time.
- (3)
Function of sightseeing plan and record sharing
Regarding the usefulness of the function of sightseeing plan and record sharing, 95% very highly rated this function as they responded with “strongly agree” or “agree”. As a result of the chi-square test for
Table 4, there was no bias in the evaluations caused by the different travel experiences to the operation target area(
). Therefore, the function which allowed users to share sightseeing information with other users and accumulate such information was effective in collecting information before traveling.
- (4)
Function of virtual city walk experience
Regarding the usefulness of the function of virtual city walk experience, 88% highly rated this function as they responded with “strongly agree” or “agree”. As a result of the chi-square test for
Table 5, there was no bias in the evaluations caused by the different travel experiences to the operation target area (
). Therefore, regardless of users’ travel experiences to the operation target area, the function was useful in reducing the burden of previewing tourist destinations.
Regarding the appropriateness of the function of virtual city walk experience, 68% responded with “strongly agree” or “agree” while 32% responded with “disagree” or “strongly disagree”. Therefore, users can generally have a detailed image of the operation target area by using this function. On the other hand, the function had many negative evaluations in comparison with the other functions, and the expressiveness of the 3D city model itself mentioned in the comment section was raised as the reason. As the data of the 3D city model is continuously being updated, it can be expected that users’ evaluations will also improve. However, as a result of the chi-square test for
Table 6, there was no bias in the evaluations caused by the different travel experiences to the operation target area
). Accordingly, regardless of users’ travel experiences to the operation target area, they can grasp the general image by using the function.
6.1.3. Evaluation of the System as a Whole
- (1)
Usefulness of the system for tourism support
Regarding the usefulness of the system for tourism support, 95% very highly rated this system as they responded with “strongly agree” or “agree”. As a result of the Pearson's chi-square test for
Table 7, there was no bias in the evaluations caused by the different travel experiences to the operation target area (
). Therefore, regardless of users’ travel experiences to the operation target area, the system can support the travel of users.
- (2)
Expectation to the future use of the system
Regarding the expectation to the future use of the system, 89% responded positively with “strongly agree” or “agree”. As a result of the Pearson's chi-square test for
Table 8, there was no bias in the evaluations caused by the different travel experiences to the operation target area (
). Therefore, regardless of users’ travel experiences to the operation target, it can be expected that the system will be continuously utilized by users.
6.2. Evaluation based on access analysis
An access log analysis was conducted using users’ log data during the operation of this system. Google Analytics of Google was used in the present study. Specifically, the access log can be obtained by calling the Python Program, which contains the analysis code created with Google Analytics, from the HTML file read on each page within the website subject to the access analysis.
Table 9 shows the analysis result concerning the devices users used to access the system. A cumulative total of 160 users accessed the system during the operation period. In addition, regarding the devices used as a method to access the system, 89 used mobile information terminals while 71 used PCs. Furthermore, there were 155 sessions with engagement, the average ratio of engagement to users was 70%, and the average engagement time was 4 minutes 13 seconds.
Based on these results, it was revealed that while mobile information terminals had a higher access number, the engagement rate was lower than that of PCs. Therefore, this showed that while many users easily used the system on their mobile information terminals, they use PCs to spend a long time to try out the various function. On the other hand, the responsive design that allows the same functions to be used on both mobile information terminals and PCs was effective.
Next,
Table 10 shows the top 9 pages with the highest number of visits. According to
Table 10, the function of virtual city walk experience, the list of sightseeing spots, the function of sightseeing plan and record creation, and the function of sightseeing plan and record sharing have many views. Therefore, there was a high number of visits to the pages of main functions aimed to provide tourism support, which is the purpose of the system. Consequently, it is clear that the use of the system was consistent with the purpose of the present study.
6.3. Extraction of Solutions for the system
The solutions for this system extracted based on the results of the questionnaire survey and the access log analysis can be summarized as shown below.
- (1)
System operation
By temporarily saving the information in the frontend, the communication between the frontend and backend can be minimized and the page load time can be reduced. Additionally, the effort required of users can be reduced by prioritizing the loading of views instead of fully loading all the data on each page at once, and conducting an asynchronous loading of the internal data afterward. Moving the system even faster and reducing the number of page transitions can reduce the burden of users and improve the utilization value of the system.
- (2)
Interface
The system was designed with a hierarchical structure that allows users to access each function from the top page as a starting point. However, the website structure will be modified in order for users to be able to select the stage of travel (before, during and after) and search for any information they need at each stage. This change will reduce the number of views and choices of information.
- (3)
Expansion of the functions used to create sightseeing plans
The amount of information provided for users can be increased by visualizing the view count of sightseeing spots as well as the number of times each spot was included in a sightseeing plan on the digital map. Additionally, by adding videos and audio clips to the sightseeing spot information, it is anticipated that this will help users to have a clearer image of the tourist destination and create satisfying sightseeing plans.
7. Conclusion
In the present study, after designing and developing the system (
Section 3 and
Section 4), the operation was conducted (
Section 5), and the evaluations and solutions were extracted (
Section 6). Specifically, in the present study, an original tourism support system was designed and developed with the purpose of reducing the burden of tourists who are unfamiliar with the tourist destinations in particular. An original tourism planning support system and Web-GIS were integrated into a single system, and two original functions were implemented. One function enables the system to efficiently collect and update the static and dynamic information in real time from tourism-related web media and social media in real time (the function of sightseeing spot information viewing). The other function visualizes and displays such information in the VR space which was developed adopting a 3D city model of the operation target area (the function of virtual city walk experience).
The area of Osaka City was selected as the operation target area, and the information of a total of 529 sightseeing spots was collected from tourism-related web media, and then saved to the database of the system beforehand. The system was operated for a period of one month during December 21st, 2022 to January 24th, 2023. During the operation period, a cumulative total of 160 users accessed the system. Additionally, the system had 10 sightseeing plans and one travel record registered as well as seven sightseeing spots submitted by users.
In order to evaluate the system, an online questionnaire survey for 56 users and an access log analysis were conducted. According to the questionnaire survey results, the system was effective for tourism support, and it is anticipated that it will be continuously utilized by users. Furthermore, excluding the function of sightseeing plan and record creation, the main functions were highly rated regardless of users’ travel experiences to the operation target area. Additionally, based on the access log analysis results, it was clear that the use of the system was in line with the purpose of the present study, as the number of visits to the page for the main functions were high.
Regarding future study topics, the advancement of the system according to the solutions listed in
Section 6.3 as well as the improvement of the utilization value by increasing the usage performance through the operation in other urban tourist destinations can be considered.
Acknowledgments
In the operation of the dynamic real-time navigation system and the web questionnaires of the present study, enormous cooperation was received from those in Japan. We would like to take this opportunity to gratefully acknowledge them.
References
- Ministry of Health, Labour and Welfare. White Paper on Health, Labour and Welfare 2011; Ministry of Health, Labour and Welfare: Tokyo, Japan, 2011. [Google Scholar]
- Ministry of Internal Affairs and Communications. White Paper on Telecommunications 2022; Ministry of Internal Affairs and Communications: Tokyo, Japan, 2022. [Google Scholar]
- Ministry of Internal Affairs and Communications. White Paper on Telecommunications 2011; Ministry of Internal Affairs and Communications: Tokyo, Japan, 2011. [Google Scholar]
- Niida, S.; Harada, E. Analysis and understanding of communication in advanced information society. The Journal of the Institute of Electronics, Information and Communication Engineers 2011, 94, 226–231. [Google Scholar]
- Kazama, K. Information acquisition from the web by social networks. Information Science and Technology Association 2012, 63, 28–33. [Google Scholar]
- Okumura, M. Social media mining. IEICE Fundamentals Review 2013, 6, 285–293. [Google Scholar] [CrossRef]
- Hodaka, T. Media choice at the time of information overload. Research and Survey on Broadcasting 2018, 12, 20–45. [Google Scholar]
- Koga, Y.; Yamamoto, K. A Tourism planning support system with Gamification. Journal of Geographic Information System 2021, 13, 485–507. [Google Scholar] [CrossRef]
- Ikizawa-Naitou, K.; Yamamoto, K. A support system of sightseeing tour planning using public transportation in Japanese rural areas. Journal of Civil Engineering and Architecture 2020, 14, 316–332. [Google Scholar] [CrossRef]
- Kato, K.; Yamamoto, K. A sightseeing spot recommendation system that takes into account the visiting frequency of users. International Journal of Geo-Information 2020, 9, 411. [Google Scholar] [CrossRef]
- Japan Travel Bureau Foundation. Trend of Japanese Tourists after the COVID-19 Pandemic. Available online: https://www.jtb.or.jp/wp-content/uploads/2022/05/covid-19-japanese-tourists-20_JTBF220513.pdf (accessed on 13 January 2023).
- Kurata, Y. Potential-of-interest maps for mobile tourist information services. In Information and communication technologies in tourism 2012; Fuchs, M., Ricci, F., Cantoni, L., Eds.; Springer: Berlin, Germany, 2012; pp. 239–248. [Google Scholar]
- Kurata, Y.; Ai, H.; Sanada, F. Creation of innovative tourist maps based on the user-posted data of a photo-sharing site. The International Journal of Tourism Science 2015, 8, 151–154. [Google Scholar]
- Zhuang, C.; Ma, Q.; Liang, X.; Yoshikawa, M. Discovering obscure sightseeing spots by analysis of geo-tagged social images. In Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), Paris, France, 25–28 August 2015. [Google Scholar]
- García-Palomares, J.C.; Gutiérrez, J.; Mínguez, C. Identification of tourist hot spots based on social networks: A comparative analysis of European metropolises using photo-sharing services and GIS. Applied Geography 2015, 63, 408–417. [Google Scholar] [CrossRef]
- Sugimoto, K. Use of GIS-based analysis to explore the characteristics of preferred viewing spots indicated by the visual interest of visitors. Landscape Research 2013, 43, 345–359. [Google Scholar] [CrossRef]
- Kaufmann, M.; Siegfried, P.; Huck, L.; Stettler, J. Analysis of tourism hotspot behaviour based on geolocated travel blog data: The case of Qyer. International Journal of Geo-Information 2019, 8, 493. [Google Scholar] [CrossRef]
- Hirota, M.; Endo, M.; Kato, D.; Ishikawa, H. Discovering hotspots using photographic orientation and angle of view from social media site. International Journal of Informatics Society 2019, 10, 109–117. [Google Scholar]
- Fajuyigbe, O.; Balogun, V.F.; Obembe, O.M. Web-Based Geographical Information System (GIS) for tourism in Oyo State, Nigeria”. Information Technology Journal 2007, 6, 613–622. [Google Scholar] [CrossRef]
- Chang, G.; Caneday, L. Web-based GIS in tourism information search: Perceptions, tasks, and trip attributes. Tourism Management 2011, 32, 1435–1437. [Google Scholar] [CrossRef]
- Singh, S.P.; Sharma, J.; Singh, P. A geo-referenced information system for tourism (GeoRIST). International Journal of Geomatics and Geosciences 2011, 2, 456–464. [Google Scholar]
- Masron, T.; Mohamaed, B.; Marzuki, A. GIS base tourism decision support system for Langkawi Island, Kedah, Malaysia. Theoretical and Empirical Researches in Urban Management 2015, 10, 21–35. [Google Scholar]
- Masron, T. Ismail N. Marzuki A. The conceptual design and application of web-based tourism decision support systems. Theoretical and Empirical Researches in Urban Management 2016, 11, 64–75. [Google Scholar]
- Bali, A.; Monavari, S.M.; Riazi, B.; Khorasani, M.; Zarkeh, M.M.K. A spatial decision support system for ecotourism development in caspian hyrcanian mixed forests ecoregion. Boletim de Ciencias Geodesicas 2016, 21, 340–353. [Google Scholar] [CrossRef]
- Itou, J.; Mori, T.; Munemori, J.; Babguchi, N. Development of a stroll support system using route display on a map and image sharing service. In Collaboration technologies and social computing; Egi, H., Yuizono, T., Baloian, N., Yoshino, T., Ichimura, S., Rodrigues, A., Eds.; Springer: Berlin, Germany, 2018; pp. 48–55. [Google Scholar]
- Koga, Y.; Yamamoto, K. A tourism planning support system with gamification. Journal of Geographic Information System 2021, 13, 485–507. [Google Scholar] [CrossRef]
- Guttentag, D.A. Virtual reality: Applications and implications for tourism. Tourism Management 2010, 31, 637–651. [Google Scholar] [CrossRef]
- Tan, Y.; Jia, J.; Kang, Y.; Peng, S.; Zhang, B. Architecture design of Jinggangshan virtual tourism system based on WebVR. Smart Tourism 2020, 1, 1–7. [Google Scholar] [CrossRef]
- Noguera, J.M.; Barranco, M.J.; Segura, R.J.; Martinez, L. A mobile 3D-GIS hybrid recommender system for tourism. Information Sciences 2012, 215, 37–52. [Google Scholar] [CrossRef]
- Chiao, H.M.; Chen, Y.L.; Huang, W.H. Examining the usability of an online virtual tour-guiding platform for cultural tourism education. Journal of Hospitality, Leisure, Sport & Tourism Education 2018, 23, 29–38. [Google Scholar]
- Beck, J.; Rainoldi, M.; Egger, R. Virtual reality in tourism: A state-of-the-art review. Tourism Review 2019, 74, 586–612. [Google Scholar] [CrossRef]
- Poux, F.; Valembois, Q.; Mattes, C.; Kobbelt, L.; Billen, R. Initial user-centered design of a virtual reality heritage system: Applications for digital tourism. Remote Sensing 2020, 12, 2583. [Google Scholar] [CrossRef]
- Hou, T. Virtual tourism simulation system based on VR technology. In Proceedings of the 2nd International Conference on Computing and Data Science (CONF-CDS 2021), Stanford, CA, US, 28–29 January 2021. [Google Scholar]
- Putra, A.S.; Dona, D.; Akhirianto, P.M.; Aisyah, N. Designing a virtual Jakarta tourism application on android OS and virtual reality tools. International Journal of Science, Technology & Management 2021. [Google Scholar] [CrossRef]
- Aziz, K.A.; Siang, T.G. Virtual reality and augmented reality combination as a holistic application for heritage preservation in the Unesco world heritage site of Melaka. International Journal of Social Science and Humanity 2014, 4, 333–337. [Google Scholar] [CrossRef]
- Bruno, F.; Lagudi, A.; Barbieri, L.; Muzzupappa, M.; Ritacco, G.; Cozza, A.; Cozza, M.; Peluso, R.; Lupia, M.; Cario, G. Virtual and augmented reality tools to improve the exploitation of underwater archaeological sites by diver and non-diver tourists. In Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection; Ioannides, M., Fink, E., Moropoulou, A., Hagedorn-Saupe, M., Fresa, A., Liestøl, G., Rajcic, V., Grussenmeyer, P., Eds.; Springer: Berlin, Germany, 2016; pp. 269–280. [Google Scholar]
- Gretzel, U.; Zhong, L.; Koo, C. Application of smart tourism to cities. International Journal of Tourism Cities 2016, 2. [Google Scholar] [CrossRef]
- Nayyar, A.; Mahapatra, B.; Le, D.N.; Suseendran, G. Virtual Reality (VR) & Augmented Reality (AR) technologies for tourism and hospitality industry. International Journal of Engineering & Technology 2018, 7, 156–160. [Google Scholar]
- Makino, R.; Yamamoto, K. Spatiotemporal Information System Using Mixed Reality for Area-Based Learning and Sightseeing. In Computational Urban Planning and Management for Smart Cities; Geerman, S., Zhan, Q., Allan, A., Pettit, C., Eds.; Springer: Berlin, Germany, 2019; pp. 283–302. [Google Scholar]
- Bec, A.; Moyle, B.; Schaffer, V.; Timms, K. Virtual reality and mixed reality for second chance tourism. Tourism Management 2021, 83. [Google Scholar] [CrossRef]
- Go, C.; Hara, H.; Fujita, S. Design of Agent type of a local information sharing system. IEICE technical report 2005, 105, 7–12. [Google Scholar]
- Kanekiyo, Y.; Hayakawa, H.; Tagashira, S.; Nakanishi, T.; Fukuda, A. A Location Correction Technique Applying Geographical Locality in Estimation Errors for wikiLocation. ITE Technical Report 2008, 32, 87–92. [Google Scholar]
- Horikawa, M.; Nonaka, T.; Sugawara, M. Information System Supporting Community Activities of Regional Shopping Streets (Case Study). Journal of Japan Industrial Management Association 2012, 63, 18–28. [Google Scholar]
- Yanagisawa, T.; Yamamoto, K. A study on information sharing GIS to accumulate local knowledge in local community. Theory and Application of GIS 2012, 20, 61–70. [Google Scholar] [CrossRef]
- Nakahara, H.; Yanagisawa, T.; Yamamoto, K. Study on a Web-GIS to support the communication of regional knowledge in regional communities: Focusing on regional residents' Experiential knowledge. Socio-Informatics 2012, 1, 77–92. [Google Scholar]
- Kojima, T.; Tuskada, K. Information sharing system for SNS users in the evacuation center based on location information. In Proceedings of the 11th IPSJ workshop on Groupware and Network Services, Atami, Shizuoka, Japan, 27–28 November 2014. [Google Scholar]
- Okazaki, R.; Hirotomo, M.; Mori, K.; Shiraishi, Y. Dual-Purpose Information Sharing System for Direct User Support in Both Ordinary and Emergency Times. IPSJ Journal 2014, 55, 1778–1786. [Google Scholar]
- Okuma, T.; Yamamoto, K. Study on a social media GIS to accumulate Urban disaster information accumulation of disaster information during normal times for disaster reduction measures. Socio-Informatics 2013, 2, 49–65. [Google Scholar]
- Murakoshi, T.; Yamamoto, K. Study on a social media GIS to support the utilization of disaster information: For disaster reduction measures from normal times to disaster outbreak times. Socio-Informatics 2014, 3, 17–30. [Google Scholar]
- Yamamoto, K.; Fujita, S. Development of social media GIS to support information utilization from normal times to disaster outbreak times. International Journal of Advanced Computer Science and Applications 2015, 6, 1–14. [Google Scholar] [CrossRef]
- Shibata, T.; Tominaga, T.; Hijikata, Y.; Sakata, N.; Ito, K. Study of community support in evacuation shelters based on digital divide. Transactions of the Institute of Systems, Control and Information Engineers 2018, 31, 101–111. [Google Scholar] [CrossRef]
- Ueda, T.; Ohooka, A.; Kumano, K.; Tarumi, H.; Hayashi, T.; Yaegashi, R. Tourism support system for sightseeing information creation and shaking. IPSJ SIG Notes 2015, 2015, 1–7. [Google Scholar]
- Ohoka, A.; Ueda, T.; Kumano, K.; Kubieda, T.; Ikeda, T.; Hayashi, T.; Yaegashi, R. Development of tourism information dispay system to support tourists’ submission and sharing comments. In Proceedings of the 77th National Convention of IPSJ, Kyoto, Japan, 17–19 March 2015. [Google Scholar]
- Kunieda, T.; Izumi, R.; Miyakawa, R.; Kanaya, M.; Yamada, S.; Gotoda, B.; Yoneya, Y.; Yaegashi, R. Creation of guidebook to recored travel memories: Development of KadaPam and tourists’ behaviors analysis using tourism guidebook In Shodoshima Island. IPSJ Digital Practice 2019, 10, 829–849. [Google Scholar]
- Yamada, S.; Yamamoto, K. Development of social media GIS for information exchange between regions. International Journal of Advanced Computer Science and Applications 2014, 4, 62–73. [Google Scholar] [CrossRef]
- Ishino, A. Automatic Construction of Sightseeing Support Systems using Social Media. Doctoral Dissertation, Hiroshima City University, Hiroshima, Japan, 2014. [Google Scholar]
- Yang, M.; Kiang, M.; Shang, W. Filtering big data from social media – Developing an early warning system for adverse drug reactions. Journal of Biomedical Informatics 2015, 54, 230–240. [Google Scholar] [CrossRef] [PubMed]
- Yamamoto, K.; Fujita, S. A dynamic real-time navigation system for urban tourists. In Planning Support Science for Smarter Urban Futures; Geertman, S., Allan, A., Pettit, C., Stillwell, J., Eds.; Springer: Berlin, Germany, 2017; pp. 2167–2184. [Google Scholar]
- Yoon, J.; Kim, J.W.; Jang, B. DiTeX: Disease-related topic extraction system through internet-based sources. PLoS ONE 2018. [Google Scholar] [CrossRef] [PubMed]
- Yamamoto, K.; Murayama, Y. Web portal to support remote island for sightseeing and disaster management. In Information Technology in Disaster Risk Reduction; Murayama, Y., Velev, D., Ziateva, P., Eds.; Springer: Berlin, Germany, 2021; pp. 1–13. [Google Scholar]
- Yamada, S.; Imanishi, T. Transmission system for COVID-19 pandemic related news using tweet data. In Proceedings of the 84th National Convention of IPSJ, Matsuyama, Ehime, Japan, 3–5 March 2022. [Google Scholar]
- Kusmawan, P.Y.; Hong, H.; Jeon, S.; Lee, J.; Kwon, J. Computing traffic congestion degree using SNS-based graph structure. In Proceedings of the 2014 IEEE/ACS 11th International Conference on Computer Systems and Applications (AICCSA), Doha, Qatar, 10–13 November 2014. [Google Scholar]
- Sato, K.; Seki, Y. Analysis of Congestion in Sightseeing Spots by using Twitter Logs. IPSJ SIG Notes 2015, 2015, 1–6. [Google Scholar]
- Kwak, D.; Liu, R.; Kim, D.; Nath, B.; Iftode, L. Seeing Is Believing: Sharing Real-Time Visual Traffic Information via Vehicular Clouds. IEEE Access 2016, 4, 3617–3631. [Google Scholar] [CrossRef]
- Kawai, Y.; Kumamoto, T. Local congestion degree visualization system based on the analysis of Warm tweets. DEIM Forum 2018, 2018, 3–4. [Google Scholar]
- Tran, M.D.; Saleem, N.M. Predicting High-risk Congestion areas during heavy rain using multi prediction model and maximum periodic frequent pattern algorithms. In Proceedings of the 3rd ACM Workshop on Intelligent Cross-Data Analysis and Retrieval (ICDAR '22), Newark, Nj, US, 27–29 June 2022. [Google Scholar]
- Fujihara, A. PoWaP: Proof of Work at Proximity for a crowd sensing system for collaborative traffic information collecting. Internet of Things 2020, 10. [Google Scholar] [CrossRef]
- Sakuma, K.; Sakuma, Y. A Study on the Actual Situation of CGVR in Tourism Contents and the Possibilities and Issues from the Viewpoint of Users' Evaluation. In Proceedings of the City Planning Institute of Japan, Kansai Branch, Online, 30 July 2022. [Google Scholar]
Figure 2.
System operating environment.
Figure 2.
System operating environment.
Figure 3.
Page for the function of sightseeing plan and record creation.
Figure 3.
Page for the function of sightseeing plan and record creation.
Figure 4.
Process of sightseeing plan and record creation.
Figure 4.
Process of sightseeing plan and record creation.
Figure 5.
Page for the registration of new sightseeing spots.
Figure 5.
Page for the registration of new sightseeing spots.
Figure 6.
Page for the details of sightseeing spot.
Figure 6.
Page for the details of sightseeing spot.
Figure 7.
Page for the function of sightseeing plan and record sharing.
Figure 7.
Page for the function of sightseeing plan and record sharing.
Figure 8.
Page for the details of sightseeing plan and record (3D digital map).
Figure 8.
Page for the details of sightseeing plan and record (3D digital map).
Figure 9.
Page for the function of virtual city walk experience (3D city model).
Figure 9.
Page for the function of virtual city walk experience (3D city model).
Table 1.
Cross-tabulation table of the evaluation for the usefulness of the function of sightseeing plan and record creation.
Table 1.
Cross-tabulation table of the evaluation for the usefulness of the function of sightseeing plan and record creation.
|
Evaluation |
Total |
Strongly agree/agree |
Disagree/strongly disagree |
Travel experience |
Had travel experience |
24 (24.6) |
2 (1.4) |
26 |
Had little travel experience |
29 (28.4) |
1 (1.6) |
30 |
Total |
53 |
3 |
56 |
Table 2.
Cross-tabulation table of the evaluation for the appropriateness of the function of sightseeing plan and record creation.
Table 2.
Cross-tabulation table of the evaluation for the appropriateness of the function of sightseeing plan and record creation.
|
Evaluation |
Total |
Strongly agree/agree |
Disagree/strongly disagree |
Travel experience |
Had travel experience |
21 (23.2) |
5 (2.8) |
26 |
Had little travel experience |
29 (26.8) |
1 (3.2) |
30 |
Total |
50 |
6 |
56 |
Table 3.
Cross-tabulation table of the evaluation for the usefulness of the function of sightseeing spot information viewing.
Table 3.
Cross-tabulation table of the evaluation for the usefulness of the function of sightseeing spot information viewing.
|
Evaluation |
Total |
Strongly agree/agree |
Disagree/strongly disagree |
Travel experience |
Had travel experience |
24 (24.6) |
1 (0.4) |
25 |
Had little travel experience |
31 (30.4) |
0 (0.6) |
31 |
Total |
55 |
1 |
56 |
Table 4.
Cross-tabulation table of the evaluation for the usefulness of the SNS function.
Table 4.
Cross-tabulation table of the evaluation for the usefulness of the SNS function.
|
Evaluation |
Total |
Strongly agree/agree |
Disagree/strongly disagree |
Travel experience |
Had travel experience |
24 (24.6) |
1 (0.4) |
25 |
Had little travel experience |
31 (30.4) |
0 (0.6) |
31 |
Total |
55 |
1 |
56 |
Table 5.
Cross-tabulation table of the evaluation for the usefulness of the function of virtual city walk experience function.
Table 5.
Cross-tabulation table of the evaluation for the usefulness of the function of virtual city walk experience function.
|
Evaluation |
Total |
Strongly agree/agree |
Disagree/strongly disagree |
Travel experience |
Had travel experience |
22 (22.8) |
4 (3.3) |
26 |
Had little travel experience |
27 (26.3) |
3 (3.8) |
30 |
Total |
49 |
7 |
56 |
Table 6.
Cross-tabulation table of the evaluation for the appropriateness of the function of virtual city walk experience.
Table 6.
Cross-tabulation table of the evaluation for the appropriateness of the function of virtual city walk experience.
|
Evaluation |
Total |
Strongly agree/agree |
Disagree/strongly disagree |
Travel experience |
Had travel experience |
17 (17.6) |
9 (8.4) |
26 |
Had little travel experience |
21 (20.4) |
9 (9.6) |
30 |
Total |
38 |
18 |
56 |
Table 7.
Cross-tabulation table of the usefulness of the system for tourism support.
Table 7.
Cross-tabulation table of the usefulness of the system for tourism support.
|
Evaluation |
Total |
Strongly agree/agree |
Disagree/strongly disagree |
Travel experience |
Had travel experience |
17 (17.6) |
9 (8.4) |
26 |
Had little travel experience |
21 (20.4) |
9 (9.6) |
30 |
Total |
38 |
18 |
56 |
Table 8.
Cross-tabulation table of the expectation to the future use of the system.
Table 8.
Cross-tabulation table of the expectation to the future use of the system.
|
Evaluation |
Total |
Strongly agree/agree |
Disagree/strongly disagree |
Travel experience |
Had travel experience |
23 (23.2) |
3 (2.8) |
26 |
Had little travel experience |
27 (26.8) |
3 (3.2) |
30 |
Total |
50 |
6 |
56 |
Table 9.
Analysis results concerning the devices used by users to access the system.
Table 9.
Analysis results concerning the devices used by users to access the system.
Accessed device |
Number of users |
Number of sessions with engagement |
Engagement rate (%) |
Average engagement time (second) |
Mobile information terminal |
89 |
75 |
63.0 |
101 |
PCs |
71 |
80 |
78.0 |
436 |
Total or Average |
Total 160 |
Total 155 |
Average 70.4 |
Average 253 |
Table 10.
Number of visits for each page (top 9).
Table 10.
Number of visits for each page (top 9).
Ranking |
Page name |
Number of visits |
Rate (%) |
1 |
Top page |
321 |
20.4 |
2 |
Function of virtual city walk experience |
203 |
7.3 |
3 |
List of sightseeing spots |
135 |
5.8 |
4 |
Function of sightseeing plan and record creation |
97 |
5.0 |
5 |
Function of sightseeing plan and record sharing |
74 |
4.6 |
6 |
Function of login |
56 |
4.3 |
7 |
Sightseeing plan “From Tsutenkaku to Osaka Tenmangu” |
45 |
3.0 |
8 |
Function of new user registration |
42 |
2.8 |
9 |
Details of the sightseeing plan and record |
17 |
2.7 |
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).