EGI Federation Home
Cultural Heritage

EUreka3D

From Ingestion to Visualisation: the Challenges of 3D Data in Cultural Heritage and Beyond

About

EUreka3D emerged to support the digital transformation of the Cultural Heritage sector and to meet the high demand of European Cultural Heritage Institutions (CHIs) to store, manage, share and publish in Europeana their cultural heritage objects in a trusted European environment. It also contributes to disseminating material to improve the quality of 3D digitisation and promoting best practices in the sector.

From a project pilot, EUreka3D has established the Eureka3D Data Hub, a comprehensive solution that allows CHIs to store and share their assets while maintaining control over them.
EUreka3D is an international initiative with partners from Italy, Cyprus, Spain, the Netherlands, Poland and France.

The challenge

There are many challenges associated with the ingestion, processing, aggregation and delivery of 3D content. These challenges stem from the nature of 3D content, current hardware limitations and the quality target set by the VIGIE study, followed in EUreka3D, as it promotes guidelines to ensure the highest level of quality and the best possible outcome. The current capabilities of consumer computers and networks impose limitations and challenges in the design of the EUreka3D platform. Quite often, the processing of 3D data online is done on the client side, so the actual device users use plays a key role. This must be considered when designing 3D experiences, which are affected by network limitations, computer memory or processing capacity.

The 3D industry has greatly evolved over the years but still lacks the standardisation level that 2D content has. This lack of standards for the use of 3D data makes it a challenge to decide on a universal 3D format. There is no complete alignment between the 3D software to process 3D data and the software to visualise or deliver 3D experiences to users. Herein, some content providers may use a format for the archival of 3D data, but this may not be the best choice for visualisation or delivery to end users. For example, OBJ is a widely known format, commonly accepted by 3D software and 3D visualisation libraries. Still, it is less space-efficient for data, making it a poor choice if the data to be sent over a network are too large. Such cases can benefit from a binary format such as PLY. The Nexus multi-resolution format, created by CNR, delivers 3D data more efficiently over the network; however, it is not supported by common software, and current technical challenges make it unsuitable for 3D CAD data. Some algorithms and 3D formats focus on compression ratio, while others focus on performance. It is usually a trade-off: compression makes more efficient use of space (benefiting, for example, the storage or transfer of a file) but increases processing effort (both for compressing and decompressing the data). These are not intrinsic problems for 3D, as 2D content also suffers from them, but they are more prominent in 3D because 3D is more complex in nature, and 3D content requires extensively larger amounts of space than 2D content, which affects its storage, processing and transfer over a network.

Another difference with the 2D industry is that the 2D industry has already solved basic aspects of 2D content visualisation. Even if new 2D formats emerge to solve new problems or improve certain aspects, the use of 2D content is basically transparent to developers, who for the most part do not have to deal with the burden of implementing or configuring 2D visualisation tools. For example, using an image on a Web page is a simple process that barely requires any effort from the developer, as the Web browser is already prepared to handle the situation in a globally expected way. However, the use of 3D content may still require developers to address some fundamental questions and make decisions on aspects such as the support library to be used, the data format to be accepted for efficient delivery and processing, and so on.

The Cultural Heritage sector can very much benefit from recent trends in IT, such as the use of cloud technology, and this is part of the way forward in the necessary digital transformation of the discipline. This is clearly evident from the storage needs of cultural heritage objects, especially those implementing the #MemoryTwins idea (as opposed to Digital Twins), which not only store the geometric structure of 3D models but all the analyses that tell the story of an object.

Metadata (information about a Cultural Heritage object) and paradata (information about the digitisation process of a Cultural Heritage object) are also necessary requirements of digital objects in Cultural Heritage. 3D metadata information has been studied for a long time, and many of the challenges involved have been minimised with the help of the Europeana Data Model (EDM), which provides a common framework for the understanding of systems that exchange Cultural Heritage metadata. However, paradata information processing is a necessary yet not widespread practice amongst 3D content providers and is not currently addressed by EDM. Delivering the paradata information associated with some data provides key insights into how the digitisation process was carried out to obtain the data. Although there are different initiatives and efforts focused on the description of paradata, Cultural Heritage lacks a formal data model to express them, and this is one of the future enhancements planned for the Europeana Data Model.

The Solution

EGI has implemented the EUreka3D Data Hub, a cloud-based platform, supported by a distributed data management system, virtual servers, large cloud storage and an identity and access management system compatible with EOSC that enables secure and trusted access to cloud resources. Its design is influenced by the recommendations of the VIGIE Study, the various 3D formats, the hardware and network limitations, the available formats for metadata and paradata, the existing 3D visualisation tools and the delivery of 3D data to end-users and other platforms.

 

The following EGI services have contributed to the implementation of the system:

  • EGI Check-in, used as an Identity and Access Management system that supports authentication and authorisation of users. The EUreka3D community and the associated permissions to access data are managed by this service.
  • EGI Cloud Compute, which provides virtual servers in the cloud, on-demand. They support the visualisation of 3D objects.
  • EGI DataHub, which is the core of EUreka3D Data Hub and provides a federated distributed system for data management and data publication. It provides cloud storage of 3D models and other files, metadata management, accessible through a user-friendly Web interface and an API to upload, download, share and manage data. It also enables the aggregation of 3D models in Europeana through PIDs served by B2HANDLE.

Services Provided by EGI

Login with your own credentials

Run virtual machines on-demand with complete control over computing resources

Access key scientific datasets in a scalable way

EGI services are at the basis of the successful implementation of the EUreka3D Data Hub that represents a great and unique step ahead for the establishment of a factual competence centre able to address the needs of cultural heritage institutions facing 3D digitisation. The Recommendation of the European Commission to EU Member States of November 2021 is fostering the cultural sector to increase the efforts on 3D digitisation and the response to this recommendation implies the availability of a shared European-based digital infrastructure. In this light, the EUreka3D Data Hub based on the EGI solutions represents the more advanced reply to the needs of the cultural sector. The contribution of EGI to the success of the EUreka3D initiative has been acknowledged by all the many cultural heritage institutions all over Europe, which continue to look at the EUreka3D Data Hub to address their needs in the challenging endeavour of 3D digitisation.

Antonella Fresa, Photoconsortium, EUreka3D and EUreka3D-XR Project Coordinator

Key Numbers

32 vCPU

Cloud Compute

128 GB RAM

Cloud Compute

30TB Storage

allocated on DataHub

15,218 files

for 225.4 GB

455

3D models

11

Cultural Heritage Institutions in the Community

The Providers

Through a Service Level Agreement (SLA), that is currently in place until the end of 2027, EUreka3D has been receiving service and resources from EGI providers. 

  • Cloud Computing and DataHub are provided by CYFRONET (Poland).
  • Check-in is provided by GRNET (Greece).
  • The Infrastructure Manager is provided by UPV  (Spain).

Related News

Loading...