druid>> MT__test_postgresql__n_data_ingestion>> 返回
项目作者： silviafracalossi

项目描述 ：
Master Thesis' repository to test PostgreSQL capabilities on varying data ingestion size (12/2020)
高级语言： Java
项目地址: git://github.com/silviafracalossi/MT__test_postgresql__n_data_ingestion.git


Test - Postgresql - Data Ingestion

Tester of the Postgresql ability of ingesting time series data, from 1 to N tuples at a time

Repository Structure

  • build/, containing the generated .class files after compiling the java code;
  • data/, containing the printers parsed logs files in the format of CSV files;
  • logs/, containing the log information of all the tests done;
  • resources/, containing the postgresql driver, the database credentials file and the logger properties;
  • src/, containing the java source files;
  • standalone/, containing the JAR standalone version of this repository.

In the main directory, there is:

  • compile_and_run.bash, a bash file containing the commands for compiling the java code and running it.

Requirements

  • PostgreSQL JDBC Driver (42.2.14)

Installation and running the project

  • Create the folder build;
  • Create the folder data;
    • Inside the folder, copy-paste the printers parsed log files;
  • Inside the folder resources,
    • Create a file called server_postgresql_credentials.txt, containing the username (first line) and the password (second line) to access the server PostgreSQL database;
    • Copy-paste the indicated PostgreSQL driver (called postgresql-42.2.14.jar);
  • bash compile_and_run.bash

Preparing an executable jar file

Since I couldn’t manage to find a way with the command line, I used Eclipse:

  • Open the project in Eclipse;
  • Set Java 8 as the default JRE:
    • Window > Preferences > Java > Installed JREs;
    • Select Java 8;
    • Apply and Close;
  • Set Java 8 as the compiler version:
    • Window > Preferences > Java > Compiler;
    • Compiler compliance level: 1.8;
    • Apply and Close;
  • Create the JAR file:
    • Right-click on the project folder > Export;
    • Java > Runnable JAR file > Next;
    • Launch Configuration: Main;
    • Export destination: test_postgresql_n_data_ingestion/standalone/NDataIngestionTest.jar;
    • Finish.
  • Execute the JAR file:
    • If you have this repository available:
      • From the main directory, execute java -jar standalone/NDataIngestionTest.jar.
    • If you need a proper standalone version:
      • Check the next paragraph.

Preparing the standalone version on the server

  • Connect to the unibz VPN through Cisco AnyConnect;
  • Open a terminal:
    • Execute ssh -t sfracalossi@ironlady.inf.unibz.it "cd /data/sfracalossi ; bash";
    • Execute mkdir postgresql;
    • Execute mkdir postgresql/standalone_n_ingestion;
    • Execute mkdir postgresql/standalone_n_ingestion/resources;
    • Execute mkdir postgresql/standalone_n_ingestion/data;
  • Send the JAR and the help files from another terminal (not connected through SSH):
  • Send the data file:
  • Execute the JAR file (use the terminal connected through SSH):
    • Execute cd postgresql/standalone_n_ingestion;
    • Execute nohup java -jar NDataIngestionTest.jar [M] [N] [l/s] [file_name_in_data_folder] > logs/out.txt &.