Materializing Results of Database Queries as Files (Bachelor Thesis, Ongoing)
Author
Description
Polypheny is a versatile system capable of handling a verity of data and workloads. Data can be queried using multiple query languages and interfaces. However, there are applications that do not support any interaction with a database system and instead rely on plain files for storing and retrieving data.
The aim of this project is to extend Polypheny by adding a query interface that allows the result of configurable queries to be materialized as files. However, instead of actually writing the data, the data should only be retrieved on access.
In more detail, the objectives of this project are:
- Implementing a new query interface that exposes a mountable share (e.g., FTP, SFTP, Webdav, SMB) that can be mounted on the client system.
- The result should either be represented by one file or by a set of files (one or multiple files per tuple (i.e., row / document)).
- The data format of the files should be configurable using templates.
- There should be a comprehensive set of typical data formats including CSV, JSON and XML.
- The virtual folder structure should be configurable.
- Benchmark the performance of the implemented interface.
If time allows, the project can be extended to also allow updating an entity by writing to the files.
Start / End Dates
2024/03/25 - 2024/06/24