flight

Apache Arrow Flight Data Connector

The Flight data connector will query and fetch data from an Apache Flight endpoint.

Supported parameters

• sql [Required] File or string containing a SQL query to execute.
• username [Optional] Username for authentication (omit with password if no auth).
• password [Optional] Password for authentication (omit with username if no auth).

Example Dataspace

dataspaces:
  - from: spice
    name: sql
    identifiers:
      - name: number
    measurements:
      - name: gas_used
    data:
      connector:
        name: flight
        params:
          password: <api_key>
          sql: SELECT number, timestamp, gas_used FROM eth.recent_blocks ORDER BY number DESC
      processor:
        name: arrow
        params:
          time_selector: timestamp