DistributedCloud

KLA+ February 2020 Hackathon, NIT Trichy

Cloud Storage Object with End to End Encryption.

Design and Implement a distributed cloud storage.
Similar to Google drive, where user can store and retrieve any Objects.

Basic Functionalities:

• One Web Server
• REST API

• Config File

  {
    "storage_directory":"\home\<username>\uploads",
    "node_count":4,
    "size_per_slice":1024,
    "redundancy_count":1,
    "peers":[
        "http://127.0.0.1:5000",
        "http://127.0.0.1:5001",
        "http://127.0.0.1-lt:5002",
        "http://127.0.0.1-lt:5003"
    ]
  }

  Methods

  • PUT

    • Store an incoming file and return the ID of the resource
    • PUT: http://localhost:5000/files

  • GET

    • Download the file for a given
    • GET: http://localhost:5000/files/{id}

  • LIST

    • List the files stored in the server
    • GET: http://localhost:5000/files/list

  • DELETE

    • Delete the file for a given
    • DELETE: http://localhost:5000/files/{id}

How to run:

$ python3 main.py

After that go to POSTMAN and execute the commands

MILESTONES

MILESTONE 1 (Completed)

Goal: Basic API Implementation

• Ability to Upload a file to the server
• Download the file
• List all the files on the server
• Delete a file

MILESTONE 2 (Completed)

Goal: Encryption + Load Balancing

• Uploaded file must be broken down in to chunks as mentioned on the config
• Nodes ( folders ) must be created as per the node count on config
• Nodes must be named as node_ Eg. node_1
• File chunks must be moved to the nodes with API Server uploads load balancing. Node with the least number of files must be filled first
• Metadata file(s) must be created to save information on the file chunks and their location