embulk-input-firestore

Google Cloud Firestore input plugin for Embulk.

You can use filter plugins such as embulk-filter-expand_json or embulk-filter-add_time to convert the json column to typed columns. Rename filter is also useful to rename the typed columns.

Overview

• Plugin type: input
• Guess supported: no

Configuration

• project_id: GCP project_id (string, required)
• json_keyfile: path to GCP credential json file (string, required)
• sql: A query string to fetch documents from Firestore (string, required)
• json_column_name: column name used in outputs (string, optional, default: “record”)

NOTE

• sql parameter accepts only limited syntax; see also https://github.com/syucream/FireSQL

Example

in:
  type: firestore
  project_id: "your-project-id"
  json_keyfile: path/to/credential.json
  sql: "SELECT id, name, created_at FROM users"
out:
  type: stdout

Development

shell script $ ./gradlew gem