Amazon Athena

Querying in Amazon Athena

  • Upload the files to S3:
> cd output
> aws s3 sync . s3://<your_bucket>/ethereumetl/export --region ap-southeast-1
  • Sign in to Athena https://console.aws.amazon.com/athena/home

  • Create a database:

CREATE DATABASE ethereumetl;

Airflow DAGs

Refer to https://github.com/medvedev1088/ethereum-etl-airflow for the instructions.

Tables for Parquet Files

Read this article on how to convert CSVs to Parquet.

Note that DECIMAL type is limited to 38 digits in Hive so values greater than 38 decimals will be null.