Grabbing new upstream info #1
Open
sparkyrider wants to merge 61 commits into
Open
Conversation
* Working on restart-able Dockerfile * Bunch of work on cleaner, restart-able Dockerfile * Optimizing Dockerfile further * Make sure to run run-in-docker.sh with Bash * Bugfixes * Remove unnecessary comment in Dockerfile Co-authored-by: mieubrisse <mieubrisse@gmail.com>
* fix: Fix broken find parent tx hash for receipt logic * bump the version and add changelog record
* refacor: Upgrade nearcore to 1.26.0-rc.1 * address review suggestions * update the actix-diesel dependency * rename functions * fmt * unpin actix-rt version
…objects in the DB (#300)
…rcore side anymore (#306)
…amp + index_in_actions) that is used for strict ordering
* fix: Avoid recreating access key on transfer to implicit account * refactor: Remove `AccountDeletion` logic as its also covered by `AccessKeyDeletion` * chore: Update `CHANGELOG.md`
* refactor: Switch from runing NEAR Indexer Framework to NEAR Lake Framework * start streamer with actix instead of tokio (diesel-actix) is used * fix find parent tx for receipt logic * refactor: upgraded to near-lake-framework 0.5.0 (#1) * refactor: Upgrade to NEAR Lake Framework 0.5.1 (#2) * refactor: Upgrade to NEAR Lake Framework 0.5.1 * remove .buildkite, add GH Actions workflows, drop redis requirement, fix clippy warnings * change the version to be relative to the original indexer-for-explorer * chore: Update test.yml (#3) * Update test.yml * update rust version * update ubuntu version in the workflows * add libpq-dev to cross Dockerfile * chore: Upgrade near-lake-framework to 0.5.2 (#4) * fix: Avoid recreating access key on transfer to implicit account (#5) * fix: Avoid recreating access key on transfer to implicit account * refactor: Remove `AccountDeletion` logic as its also covered by `AccessKeyDeletion` * chore: Update `CHANGELOG.md` * refactor: use `near_lake_framework` types rather than `near_primitives` * build: Migrate to Cargo Workspaces (#6) * build: Create Cargo workspace and empty `indexer` crate * build: Migrate crate root to workspaces * feat: Create empty `database` library crate * refactor: Extract db logic to `database` lib * refactor: Change `database` logging target to `explorer_database` * refactor: Rename `db_adapters` -> `adapters` * refactor: Make current in-use DB funcions public * refactor: Extract cache logic to `database` lib * refactor: Replace `near-lake-framework` with `near-indexer-primitives` * docs: Added a warning to the skipping blocks section in troubleshooting guide (#11) * feat: Introduce standalone binary to calculate circulating supply via JSON RPC (#10) * feat: Add empty `circulating_supply` crate * feat: Add missing db adapaters/models to `database` lib * feat: Add core circulating supply files * refactor: Flatten/merge `circulating_supply` files * fix: Add missing dependencies and fix broken imports Excluding `near-indexer` and `near-client` as these will be replaced * refactor: Make in-use circulating_supply functions public * refactor: Replace `near_indexer::near_primitives` with `near_lake_framework::near_indexer_primitives` * refactor: Instantiate pg pool in `main` * refactor: Replace `ViewClient` calls with `JsonRpcClient` * refactor: `await` circulating_supply in `main` * chore: Rename `tracing` target `aggregated` -> `circulating_supply` * refactor: Extract json rpc url to environment variable * feat: Subscribe to tracing events via `RUST_LOG` env * feat: Improve logging * refactor: Replace `near-indexer-framework` with `near-indexer-primtives` * fix: Base64 decode lockup state before deserializing * feat: Print `anyhow` errors with cause * chore: Add note to ensure API use is updated when upgrading near-core * chore: Use kebab case for workspace crate * chore: Add missing Changelog/Cargo version entries (#16) * chore: Update `indexer` to `10.2` * chore: Update `indexer` to `10.3` * feat: Add missing diesel `migrations` (#12) * chore: Move `migrations` to same dir as `Diesel.toml` * chore: Remove unnecessary `.gitkeep` * feat: Add missing Diesel migrations * chore: Update `README.md` for running migrations * refactor: Use default AWS SDK credentials provider (#14) * chore: Update `Cargo.toml` version to match previous code changes (#17) * feat: Enable JSON logging via environment variable (#13) * feat: Enable JSON logging via environment variable * chore: Update CHANGELOG & Cargo version * feat: Expose block metrics from Indexer over http (#15) * refactor: Move indexer stream to separate thread * feat: Standup HTTP server * fix: Ensure lake `ReceiverStream` finishes when process exits * feat: Serve block metrics via http * refactor: Rename `HTTP_PORT` -> `PORT` * chore: Update `CHANGELOG.md` and Cargo version * refactor: Rename block metrics for clarity * DPLT-632: Add Dockerfile files for circulating-supply and indexer (#18) * refactor: Metrics server config/errors (#20) * refactor: Parse `port` via CLI and env rather than just env * refactor: Return `anyhow::Result` from `metrics::init_server` * chore: Drop `-lake` suffix in Cargo name * chore: Remove unused files * chore: Delete `release.yml` as we now build in GCP * chore: Remove `Cross` * chore: Point to `docs.near.org` instead of `near-indexers.io` Co-authored-by: Bohdan Khorolets <b@khorolets.com> * chore: Add link to "store genesis" issue * chore: Add missing `chain-id` in example command * chore: Add breaking changes to `CHANGELOG.md` * chore: Rephrase paragraph about `non-strict-mode` * chore: Add subheadings for running indexer * docs: Add notes about docker deployments in Readme * refactor: Rename `retriable.rs` -> `retryable.rs` * refactor: List duplicate expr out of match clause * refactor: Swap indexing/metrics threads * feat: Handle errors thrown during indexing * refactor: Drop `-lake` prefix in metrics Co-authored-by: Bohdan Khorolets <bogdan@khorolets.com> Co-authored-by: Vlad Frolov <frolvlad@gmail.com> Co-authored-by: ecp88 <109925246+ecp88@users.noreply.github.com> Co-authored-by: Bohdan Khorolets <b@khorolets.com>
* fix: improve performance of assets__* by changing PKs * add explanations to readme
Plus update Cargo.lock, I missed this change before
* feat: Add access_key/account adapters for storing genesis * feat: Add `from-genesis` command without implementation * feat: Download genesis file * feat: Store genesis accounts/access_keys * refactor: Initialize lake framework after processing genesis * docs: Add info on `from-genesis` to `README.md` * feat: Add `betanet` s3 genesis url * refactor: Replace manual chain id conversion with `impl ToString` * feat: Show `genesis.json` download progress in logs * feat: Use `genesis.json` on disk if exists * chore: Remove unused `actix-rt` * chore: Remove unused imports * refactor: Stream genesis record processing * doc: Add note in `README.md` about RAM requirements for testnet genesis * fix: Set `target` for genesis logs * refactor: Remove genesis chain ID file prefix * refactor: Store `genesis.json` next to executable * refactor: Log genesis download every ~100kb * doc: Update `CHANGELOG.md`
We can have FK violation on transactions and receipts and it's our normal behaviour (we insert in an optimistica way, and the inserts usually go fine from 2 attempt)
* refactor: Move common deps to `workspace.dependencies` * chore: Bump `near` deps * build: Bump rust version to `1.70.0` * fix: Propagate `Genesis` construction error * fix: Dont encode already encoded base64 * chore: Cargo format
* refactor: Improve non-strict-mode to make it even less strict * chore: Cargo format --------- Co-authored-by: Morgan Mccauley <morgan@mccauley.co.nz>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
14 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.