[EN]
This post is intended to cover the server costs for SteemWorld.org and to enable me to continue my development in the future.
In case you missed the first part:
SteemWorld ~ Weekly Support ~ #1
[DE]
Dieser Post ist dafür gedacht die Serverkosten für SteemWorld.org zu decken und mir in Zukunft weitere Entwicklungen zu ermöglichen.
Falls du den ersten Teil verpasst haben solltest:
SteemWorld ~ Weekly Support ~ #1
Updates
I'm in the last steps of switching to the new server and my time is running out, so I will keep it short today. The plan was to start the new server directly with my coming SDS (Steem Data Service), but even if I made great progress in the past week, it is not ready to be used in production mode yet, therefore I need to setup my old PHP based web service and use it as a temporary solution there. Otherwise many features like mentions and the follower history wouldn't work in the coming week.
I think it's a better way to have a smooth transition, optimize SDS as much as possible to get the best out of it and finally release it, when it's really ready and stable enough to see the world. SDS includes never seen compression techniques, so that the blockchain can be stored in a super compact format. Trust me, we will need something like this when Steem goes mainstream and servers begin to run out of disk space.
Some of you may know the XZ compressor (based on LZMA), which on a level 9 (extreme mode, param: -e) setting compresses blocks to approximately 1/8 of the original size. With my SDS it is possible to compress them to a size that is ~ 0.63 times the size of the best XZ compression result. I hope that I will find the time in the coming week for an additional post to explain how I achieved that and to talk about what I'm really building here.
For most SteemWorld users that's all not really important to know, because it has to do with laying the groundwork for the future and coming SteemWorld features on the server side. I hope you don't mind, but a few 'boring' posts may still need to come until the more interesting things and the new SteemWorld features will see the light.
Coming Open Source Steem Data Service (SDS)
Some basic points I already can state here:
- Runs on Linux, Mac and Windows
- Can be run locally or as public web service
- Enables
each of usto analyze and work with the Steem blockchain data in a simple and very efficient way (SQL and custom queries can be used too) - Works as REST API:
//[domain or localhost]/sds/get_block/1
=> returns block 1 as JSON
/sds/get_blocks/1-1000
=> returns 1000 blocks (1 to 1000) with one request in second(s)
/sds/get_followers/steemchiller
=> returns my followers
... - Syncing is possible via available public instances (very fast) or regular Steem nodes
- Provides automatic downloading of already parsed data (no need to start from block 1)
- No need to setup any database services (all file-based -> no layers in between -> lightning fast)
- Offers configurable datasets (if you just need a DB with all transfers for example, you can run an instance with only the desired parser module 'transfers' enabled)
- JS developers can easily implement own parser modules (just add a custom script in the modules path and the service will call the
parseBlock,parseTransaction,parseOperationandparseVirtualOperationmethods within your script for each block) - Also 'virtual operations' can be parsed (or downloaded from one of my servers that will provide all parsed datasets in nearly realtime)
- Highly compressed data (some crazy stuff and a bit of magic involved here, more details on this soon)
- Interfaces to other database systems planned
- Completely free to use, will be released under MIT license
In the making
- Open Source Steem Data Service (SDS)
- Post Viewer & Editor
- Different views / no limit in the posts overview
- Details for coming rewards (number of posts/comments, maybe a pie chart)
- Improved coming curation rewards overview
- RC costs calculation
- SteemWorld -> Open Source?
Links
EN | What is SteemWorld?
-> Welcome to SteemWorld.org!
DE | Was ist SteemWorld?
-> Willkommen auf SteemWorld.org!
Thank you for supporting my work!
Positive thoughts create a positive world. It all begins with connecting our thoughts with emotions. What we focus on is what becomes powerful. We are the creators of our world.
Much love,