Devising a method for rapid data retrieval using explorers for blockchain analysis
DOI:
https://doi.org/10.15587/1729-4061.2023.286079Keywords:
rapid data retrieval, blockchain analysis, blockchain explorers, multithreaded data processingAbstract
The object of this study is blockchain explorers and their usefulness in efficiently gathering data for blockchain network analysis. The process of blockchain analysis typically involves deploying and synchronizing a blockchain node, which requires significant computational resources and time for synchronization. Analyzing multiple blockchain networks simultaneously demands substantial effort and requires even greater costs.
The developed method involves utilizing publicly accessible blockchain explorers, which allows for rapid data retrieval with minimal computational resources for further analysis. Additionally, obtaining supplementary information from blockchain explorers provides valuable details that may be inaccessible using traditional data retrieval methods.
The efficiency of the proposed method was verified through the development of a prototype system. Data was collected for 14 specified blockchain networks to analyze smart contracts within these networks. Information about accounts (including balance statistics) was gathered, smart contracts were identified among the accounts, data on existing tokens owned by smart contracts was obtained, and bytecode and source code (where available) of contracts were collected and decompiled. The process took nearly 24 hours on a cloud computing machine with minimal configuration.
Based on the collected data, an example smart contract was analyzed to demonstrate the completeness of the process. The results of this research minimize computational resource expenses and allow for a simplified and rapid data gathering process without manual configuration, enabling researchers and analysts to concentrate on subsequent stages of analysis
References
- Iyer, K., Dannen, C. (2018). Building Games with Ethereum Smart Contracts. Apress Berkeley, 269. doi: https://doi.org/10.1007/978-1-4842-3492-1
- Dorogyy, Y., Kolisnichenko, V. (2023). Blockchain Transaction Analysis: A Comprehensive Review of Applications, Tasks and Methods. System research and information technologies. (In Press)
- Werner, R., Lawrenz, S., Rausch, A. (2020). Blockchain Analysis Tool of a Cryptocurrency. Proceedings of the 2020 The 2nd International Conference on Blockchain Technology. doi: https://doi.org/10.1145/3390566.3391671
- Hardware requirements. Go-Ethereum. Available at: https://geth.ethereum.org/docs/getting-started/hardware-requirements
- Luo, Z., Murukutla, R., Kate, A. (2022). Last Mile of Blockchains: RPC and Node-as-a-service. arXiv. doi: https://doi.org/10.48550/arXiv.2212.03383
- Kalodner, H., Möser, M., Lee, K., Goldfeder, S., Plattner, M., Chator, A., Narayanan, A. (2020). BlockSci: Design and applications of a blockchain analysis platform. 29th USENIX Security Symposium, 2721–2738. Available at: https://www.usenix.org/system/files/sec20-kalodner.pdf
- Kılıç, B., Özturan, C.Sen, A. (2022). Parallel analysis of Ethereum blockchain transaction data using cluster computing. Cluster Computing, 25 (3), 1885–1898. doi: https://doi.org/10.1007/s10586-021-03511-0
- Kuzuno, H., Karam, C. (2017). Blockchain explorer: An analytical process and investigation environment for bitcoin. 2017 APWG Symposium on Electronic Crime Research (ECrime). doi: https://doi.org/10.1109/ecrime.2017.7945049
- Wen, X., Yeo, K. S., Wang, Y., Cheng, L., Zhu, F., Zhu, M. (2023). Code Will Tell: Visual Identification of Ponzi Schemes on Ethereum. Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. doi: https://doi.org/10.1145/3544549.3585861
- Acala chain explorer. Acala.network. Available at: https://blockscout.acala.network/
- Aves explorer. Avescan.io. Available at: https://avescan.io
- Energy web chain energy web foundation explorer. Energyweb.org. Available at: https://explorer.energyweb.org
- Eraswap explorer. Eraswap.Info. Available at: https://eraswap.info
- Karura chain explorer. Karura.network. Available at: https://blockscout.karura.network
- Kava Ethereum Co-Chain Explorer. Kava.io. Available at: https://explorer.kava.io
- MCH verse explorer. Mycryptoheroes.net. Available at: https://explorer.oasys.mycryptoheroes.net
- Nahmii explorer. Nahmii.io. Available at: https://explorer.nahmii.io
- Neatio. Neatio.net. Available at: https://scan.neatio.net
- Oasys explorer. Oasys.Games. Available at: https://scan.oasys.games
- BONE BONE explorer. Shib.io. Available at: https://puppyscan.shib.io
- Rootstock (RBTC) explorer. Blockscout.com. Available at: https://blockscout.com/rsk/mainnet
- SmartBCH explorer. Sonar.Cash. AVAILABLE AT: https://sonar.cash
- Xiden explorer. Xiden.com. Available at: https://explorer.xiden.com
- SSD VPS Servers, Cloud Servers and Cloud Hosting. Vultr.com. Available at: https://www.vultr.com/
- Ethereum. Verified Contracts. Etherscan.io. Available at: https://etherscan.io/contractsVerified/
- Blockchair - Universal blockchain explorer and search engine. Blockchair.com. Available at: https://blockchair.com/
- Chains & projects using blockscout. Blockscout.com. Available at: https://docs.blockscout.com/about/projects
- Blockchain Explorer - Bitcoin Tracker & More. Blockchain.com. Available at: https://www.blockchain.com/explorer
- Blockchain Explorer By Bitquery. Bitquery Explorer. Available at: https://explorer.bitquery.io/
- Etherscan Explorer Services. Etherscan.io. Available at: https://etherscan.io/eaas
- Unmarshal Blockchain Explorer. Xscan.io. Available at: https://xscan.io/
- Open source Ethereum blockchain explorer. Beaconcha.In. Available at: https://beaconcha.in/
- otterscan: A blazingly fast, local, Ethereum block explorer built on top of Erigon. Available at: https://github.com/otterscan/otterscan
- Blockhead - track, visualize & explore all of crypto, DeFi & web3. Blockhead.Info. Available at: https://blockhead.info/explorer
- ethernal: Ethernal is a block explorer for EVM-based chains. Available at: https://github.com/tryethernal/ethernal
- xpl. Available at: https://3xpl.com/
- ethVM: An Open Source Block Explorer for Ethereum with Users In Mind. Available at: https://github.com/EthVM/EthVM
- explorer: Block explorer showcasing the BlockCypher APIs. Available at: https://github.com/blockcypher/explorer
- Search for block, transaction, address. Blockexplorer.One. Available at: https://blockexplorer.one/
- The General Multi-chain Explorer and Blockchain API. Tokenview.io. Available at: https://tokenview.io/
- Blockchain Explorer. Coinmarketcap.com. Available at: https://blockchain.coinmarketcap.com/
- OpenAI (2023). GPT-4 Technical Report. arXiv. doi: https://doi.org/10.48550/arXiv.2303.08774
- OpenAI platform. Openai.com. Available at: https://platform.openai.com/docs/api-reference
- Beautifulsoup4. PyPI. Available at: https://pypi.org/project/beautifulsoup4/
- palkeo. panoramix: Ethereum decompiler. Available at: https://github.com/palkeo/panoramix
- Meisami, S., Bodell, W. E. (2023). A Comprehensive Survey of Upgradeable Smart Contract Patterns. arXiv. doi: https://doi.org/10.48550/arXiv.2304.03405
- multiprocessing - Process-based parallelism. Python Documentation. Available at: https://docs.python.org/3/library/multiprocessing.html
- StakeAVS (0x75fA5fecE2A9783e28856c1A7EA3Af544690ebc8) - explorer. Avescan.Io. Available at: https://avescan.io/address/0x75fA5fecE2A9783e28856c1A7EA3Af544690ebc8
- Stake.Sol. Available at: https://gist.github.com/VaWheel/072250e3b419fb9ad8e5c9b411776579
- StakeDecompiled.Py. Available at: https://gist.github.com/VaWheel/ad80df2f8b15067388876e92d8b80901
- Online Solidity Decompiler. Available at: https://ethervm.io/decompile
- RSK explorer. Rsk.Co. Available at: https://explorer.rsk.co/
- Blockchair - Crunchbase Company Profile & Funding. Crunchbase.com. Available at: https://www.crunchbase.com/organization/blockchair
- Block Explorers. Alchemy.com. Available at: https://www.alchemy.com/best/block-explorers
- API - Blockscout. Blockscout.com. Available at: https://docs.blockscout.com/for-users/api
- Brenning, A., Henn, S. (2023). Web scraping: a promising tool for geographic data acquisition. arXiv. doi: https://doi.org/10.48550/arXiv.2305.19893
- EVM Bytecode Decompiler. Dedaub.com. Available at: https://library.dedaub.com/decompile
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Yaroslaw Dorogyy, Vadym Kolisnichenko
This work is licensed under a Creative Commons Attribution 4.0 International License.
The consolidation and conditions for the transfer of copyright (identification of authorship) is carried out in the License Agreement. In particular, the authors reserve the right to the authorship of their manuscript and transfer the first publication of this work to the journal under the terms of the Creative Commons CC BY license. At the same time, they have the right to conclude on their own additional agreements concerning the non-exclusive distribution of the work in the form in which it was published by this journal, but provided that the link to the first publication of the article in this journal is preserved.
A license agreement is a document in which the author warrants that he/she owns all copyright for the work (manuscript, article, etc.).
The authors, signing the License Agreement with TECHNOLOGY CENTER PC, have all rights to the further use of their work, provided that they link to our edition in which the work was published.
According to the terms of the License Agreement, the Publisher TECHNOLOGY CENTER PC does not take away your copyrights and receives permission from the authors to use and dissemination of the publication through the world's scientific resources (own electronic resources, scientometric databases, repositories, libraries, etc.).
In the absence of a signed License Agreement or in the absence of this agreement of identifiers allowing to identify the identity of the author, the editors have no right to work with the manuscript.
It is important to remember that there is another type of agreement between authors and publishers – when copyright is transferred from the authors to the publisher. In this case, the authors lose ownership of their work and may not use it in any way.