Alex Browne
7198b441e0
Add script for parsing competing dex trades from Bloxy ( #1355 )
2018-12-04 14:25:42 -08:00
Alex Browne
3d211c415b
Introduce framework for running basic tests for entities ( #1344 )
...
* Introduce framework for running basic tests for entities
* Add pipeline tests to CircleCI config
* Make pipeline tests more configurable and fix CircleCI config
* Add coverage dir to pipeline package
* Add basic tests for all exchange event entities
* Add tests for remaining entities
* Create separate test scripts in package.json and add new info to README
* Update db_setup.ts to revert migrations even if you are using docker
* Automatically pull the postgres image if needed
* Add comment about why NumberToBigIntTransformer is needed
2018-12-04 14:25:38 -08:00
Alex Browne
4061731245
[pipeline] Add additional documentation to the README ( #1328 )
2018-12-04 14:24:48 -08:00
Alex Browne
96fdb9b766
Reduce number of blocks per query in pull_missing_events
2018-12-04 14:24:48 -08:00
Jake Ellowitz
1aa3f9d69f
updating comment for 0x trusted tokens
2018-12-04 14:24:48 -08:00
Jake Ellowitz
dea89c4e22
metadata and trusted sources in same raw table
2018-12-04 14:24:48 -08:00
Jake Ellowitz
c6af5131b0
Pull token metadata re trusted tokens
2018-12-04 14:24:48 -08:00
Alex Browne
9986717671
Add script for pulling missing block data
2018-12-04 14:24:48 -08:00
Alex Browne
5cad2ad174
Check for special characters in table name in pull_missing_events
2018-12-04 14:24:48 -08:00
Alex Browne
24fd2d9730
Add support for pulling Cancel and CancelUpTo events
2018-12-04 14:24:48 -08:00
Alex Browne
0397ff8b22
Add transactionHash to CancelUpToEvent and CancelEvent entities
2018-12-04 14:24:48 -08:00
Alex Browne
1a25862086
Optimize database operations in pull_missing_events script
2018-12-04 14:24:48 -08:00
Alex Browne
b771020f88
Add homepage_url to relayers
2018-12-04 14:24:48 -08:00
Alex Browne
b42cf0c797
Add workaround for broken save method
2018-12-04 14:24:48 -08:00
Alex Browne
8076333795
Fix chunk size in pull_missing_events
2018-12-04 14:24:48 -08:00
Alex Browne
b0a2c10e11
Use built-in chunk feature of TypeORM save method
2018-12-04 14:24:48 -08:00
Alex Browne
303bbc42f4
Change some column types from varchar to numeric
2018-12-04 14:24:48 -08:00
Alex Browne
10e93bb01f
Add raw schema prefix to query in pull_missing_events
2018-12-04 14:24:48 -08:00
Alex Browne
a948305e7a
Rename taker and maker amounts in sra_orders
2018-12-04 14:24:48 -08:00
Alex Browne
26280e4aba
Implement scraping sra orders from radar relay
2018-12-04 14:24:48 -08:00
Alex Browne
55bbe1954b
Preliminary work for adding RR order book scraping
2018-12-04 14:24:48 -08:00
Alex Browne
2cbb82eb04
Update schema for sra_orders
2018-12-04 14:24:48 -08:00
Jake Ellowitz
96134003e1
Pointing entities to raw schema
...
Fix linter issues
2018-12-04 14:25:00 -08:00
Jake Ellowitz
599a3f9b96
Mapping dev schema to initial migration
2018-12-04 14:24:48 -08:00
Alex Browne
688d277b30
Configure linter with --format stylish and fix linter errors
2018-12-04 14:24:48 -08:00
Alex Browne
329c68f610
Configure TypeORM for migrations. Add new package.json scripts.
2018-12-04 14:24:48 -08:00
Alex Browne
6fb333f200
Rename Transaction.ts to transaction.ts
...
Rename Relayer.ts to relayer.ts
Rename Block.ts to block.ts
2018-12-04 14:24:55 -08:00
Alex Browne
410a924495
Add better error handling for immediately invoked async functions
2018-12-04 14:24:48 -08:00
Alex Browne
53cc9e9bed
Rename table and column names
2018-12-04 14:24:48 -08:00
Alex Browne
ccad046eb6
Reorganize entities. Make scripts work from any directory.
2018-12-04 14:24:48 -08:00
Alex Browne
954c3b9272
Split index.ts into multiple scripts in scripts/ and detect last known block when pulling events
2018-12-04 14:24:48 -08:00
Alex Browne
9cb89725c9
Remove unused function parameter in index.ts script
2018-12-04 14:24:48 -08:00
Alex Browne
830d0f3b21
Use bigint for gasUsed and gasPrice in Transaction
2018-12-04 14:24:48 -08:00
Alex Browne
8248fbb231
Update relayer code to use new relayer-registry format
2018-12-04 14:24:48 -08:00
Alex Browne
dca2a4e9c2
Remove outdated info from README
2018-12-04 14:24:48 -08:00
Alex Browne
21d4807206
Add build:ci to pipeline package.json
2018-12-04 14:24:48 -08:00
Alex Browne
5e22a862b7
Implement fetching and parsing relayer info
2018-12-04 14:24:48 -08:00
Alex Browne
bb440b683a
Implement support for getting and parsing blocks and transactions
2018-12-04 14:24:48 -08:00
Alex Browne
d959b3e234
chore: Fix tslint config.
2018-12-04 14:24:49 -08:00
Alex Browne
aeff948c9a
Fix bugs in merge_v2_events script and disable verbose logging
2018-12-04 14:24:48 -08:00
Alex Browne
7945d2ea62
Enable verbose logging
2018-12-04 14:24:48 -08:00
Alex Browne
af2546bc58
Rename index.ts -> merge_v2_events
2018-12-04 14:24:48 -08:00
Alex Browne
3a19faa5ff
Update script to work with existing v1 pipeline data
2018-12-04 14:24:48 -08:00
Alex Browne
bbe1a843ef
Update pipeline to use new @0x npm org for imports
2018-12-04 14:24:48 -08:00
Alex Browne
91e7485ecc
Update to use ContractWrappers + Infura instead of Etherscan
2018-12-04 14:24:44 -08:00
Alex Browne
6c00dd6f39
Rebase and update to use new modularized artifacts
2018-12-04 14:24:06 -08:00
Alex Browne
ada78d140b
Add tests for SRA order conversion
2018-12-04 14:24:06 -08:00
Alex Browne
6aca4e8272
Re-add missing tests
2018-12-04 14:24:06 -08:00
Alex Browne
dd093daf91
Add soruceUrl to SraOrder entity
2018-12-04 14:24:06 -08:00
Alex Browne
9ab55ccec0
Add preliminary support for scraping orders from SRA endpoints (no pagination, only RR support for now)
2018-12-04 14:24:06 -08:00