113 Commits

Author SHA1 Message Date
Alex Browne
7198b441e0
Add script for parsing competing dex trades from Bloxy (#1355) 2018-12-04 14:25:42 -08:00
Alex Browne
3d211c415b
Introduce framework for running basic tests for entities (#1344)
* Introduce framework for running basic tests for entities

* Add pipeline tests to CircleCI config

* Make pipeline tests more configurable and fix CircleCI config

* Add coverage dir to pipeline package

* Add basic tests for all exchange event entities

* Add tests for remaining entities

* Create separate test scripts in package.json and add new info to README

* Update db_setup.ts to revert migrations even if you are using docker

* Automatically pull the postgres image if needed

* Add comment about why NumberToBigIntTransformer is needed
2018-12-04 14:25:38 -08:00
Alex Browne
4061731245
[pipeline] Add additional documentation to the README (#1328) 2018-12-04 14:24:48 -08:00
Alex Browne
96fdb9b766
Reduce number of blocks per query in pull_missing_events 2018-12-04 14:24:48 -08:00
Jake Ellowitz
1aa3f9d69f
updating comment for 0x trusted tokens 2018-12-04 14:24:48 -08:00
Jake Ellowitz
dea89c4e22
metadata and trusted sources in same raw table 2018-12-04 14:24:48 -08:00
Jake Ellowitz
c6af5131b0
Pull token metadata re trusted tokens 2018-12-04 14:24:48 -08:00
Alex Browne
9986717671
Add script for pulling missing block data 2018-12-04 14:24:48 -08:00
Alex Browne
5cad2ad174
Check for special characters in table name in pull_missing_events 2018-12-04 14:24:48 -08:00
Alex Browne
24fd2d9730
Add support for pulling Cancel and CancelUpTo events 2018-12-04 14:24:48 -08:00
Alex Browne
0397ff8b22
Add transactionHash to CancelUpToEvent and CancelEvent entities 2018-12-04 14:24:48 -08:00
Alex Browne
1a25862086
Optimize database operations in pull_missing_events script 2018-12-04 14:24:48 -08:00
Alex Browne
b771020f88
Add homepage_url to relayers 2018-12-04 14:24:48 -08:00
Alex Browne
b42cf0c797
Add workaround for broken save method 2018-12-04 14:24:48 -08:00
Alex Browne
8076333795
Fix chunk size in pull_missing_events 2018-12-04 14:24:48 -08:00
Alex Browne
b0a2c10e11
Use built-in chunk feature of TypeORM save method 2018-12-04 14:24:48 -08:00
Alex Browne
303bbc42f4
Change some column types from varchar to numeric 2018-12-04 14:24:48 -08:00
Alex Browne
10e93bb01f
Add raw schema prefix to query in pull_missing_events 2018-12-04 14:24:48 -08:00
Alex Browne
a948305e7a
Rename taker and maker amounts in sra_orders 2018-12-04 14:24:48 -08:00
Alex Browne
26280e4aba
Implement scraping sra orders from radar relay 2018-12-04 14:24:48 -08:00
Alex Browne
55bbe1954b
Preliminary work for adding RR order book scraping 2018-12-04 14:24:48 -08:00
Alex Browne
2cbb82eb04
Update schema for sra_orders 2018-12-04 14:24:48 -08:00
Jake Ellowitz
96134003e1
Pointing entities to raw schema
Fix linter issues
2018-12-04 14:25:00 -08:00
Jake Ellowitz
599a3f9b96
Mapping dev schema to initial migration 2018-12-04 14:24:48 -08:00
Alex Browne
688d277b30
Configure linter with --format stylish and fix linter errors 2018-12-04 14:24:48 -08:00
Alex Browne
329c68f610
Configure TypeORM for migrations. Add new package.json scripts. 2018-12-04 14:24:48 -08:00
Alex Browne
6fb333f200
Rename Transaction.ts to transaction.ts
Rename Relayer.ts to relayer.ts

Rename Block.ts to block.ts
2018-12-04 14:24:55 -08:00
Alex Browne
410a924495
Add better error handling for immediately invoked async functions 2018-12-04 14:24:48 -08:00
Alex Browne
53cc9e9bed
Rename table and column names 2018-12-04 14:24:48 -08:00
Alex Browne
ccad046eb6
Reorganize entities. Make scripts work from any directory. 2018-12-04 14:24:48 -08:00
Alex Browne
954c3b9272
Split index.ts into multiple scripts in scripts/ and detect last known block when pulling events 2018-12-04 14:24:48 -08:00
Alex Browne
9cb89725c9
Remove unused function parameter in index.ts script 2018-12-04 14:24:48 -08:00
Alex Browne
830d0f3b21
Use bigint for gasUsed and gasPrice in Transaction 2018-12-04 14:24:48 -08:00
Alex Browne
8248fbb231
Update relayer code to use new relayer-registry format 2018-12-04 14:24:48 -08:00
Alex Browne
dca2a4e9c2
Remove outdated info from README 2018-12-04 14:24:48 -08:00
Alex Browne
21d4807206
Add build:ci to pipeline package.json 2018-12-04 14:24:48 -08:00
Alex Browne
5e22a862b7
Implement fetching and parsing relayer info 2018-12-04 14:24:48 -08:00
Alex Browne
bb440b683a
Implement support for getting and parsing blocks and transactions 2018-12-04 14:24:48 -08:00
Alex Browne
d959b3e234
chore: Fix tslint config. 2018-12-04 14:24:49 -08:00
Alex Browne
aeff948c9a
Fix bugs in merge_v2_events script and disable verbose logging 2018-12-04 14:24:48 -08:00
Alex Browne
7945d2ea62
Enable verbose logging 2018-12-04 14:24:48 -08:00
Alex Browne
af2546bc58
Rename index.ts -> merge_v2_events 2018-12-04 14:24:48 -08:00
Alex Browne
3a19faa5ff
Update script to work with existing v1 pipeline data 2018-12-04 14:24:48 -08:00
Alex Browne
bbe1a843ef
Update pipeline to use new @0x npm org for imports 2018-12-04 14:24:48 -08:00
Alex Browne
91e7485ecc
Update to use ContractWrappers + Infura instead of Etherscan 2018-12-04 14:24:44 -08:00
Alex Browne
6c00dd6f39
Rebase and update to use new modularized artifacts 2018-12-04 14:24:06 -08:00
Alex Browne
ada78d140b
Add tests for SRA order conversion 2018-12-04 14:24:06 -08:00
Alex Browne
6aca4e8272
Re-add missing tests 2018-12-04 14:24:06 -08:00
Alex Browne
dd093daf91
Add soruceUrl to SraOrder entity 2018-12-04 14:24:06 -08:00
Alex Browne
9ab55ccec0
Add preliminary support for scraping orders from SRA endpoints (no pagination, only RR support for now) 2018-12-04 14:24:06 -08:00