Now, we can backup up your Steem Blogs + Images with a bit more sophistication
    I was up until the wee hours last night tinkering with the code that and had successfully backup up 
To get the word out about the soon to be launched service, I will be offerring a complimentary backup job for the first 37 resteems.
All 10 slots were filled yesterday. Thanks yall!
During the process, a few shortfalls were identified:
- Some of yall are some blogging machines!
    Being that the script is designed to indiscrimately download every image to include those that are repeated in other entries. This can result in great duplication of data and hefty file sizes of the parent folder. For perspective, 
    To prevent duplication of data, I am devising a system of first collecting all file hashes in the folder structure of the past backup (sometimes it takes multiple passes with the script due to various front end limitations) and comparing it to the hash of the remote file before saving another copy to disk. Ideally, we would want to prevent the download from occuring in the first place but, as of present, I am unsure if there is a mechanism to obtain a remote file hash without downloading it. The prime consideration is to reduce the size of the block archive and we can work on other issues from there.
- Front End Limitations - Throttling / Rate Limiting
    It has appeared that we encountered a bit of issues with possible rate limiting or throttling of our HTTP GET requests after what I suspect to be too many concurrent requests. To mitigate this, I have implemented a short sleep interval prior to initiating each request; however the better option would likely be to set limits to the urllib connection pool. I will have to reference the documentation to figure it out.
Repository: https://github.com/anthonyadavisii/SteemYaLater (Will be updated once data de-duplication changes are implemented)
Would highly appreciate any stars and follows on my Github if you appreciate what I am doing & direction.
Additional features added:
- Logging
- Results to CSV
    This means will be included in the package so you may identify the images that the script was not able to obtain that you may attempt manual downloads as needed. - SSL / TLS Certificate Validation
    Reading the documentation. I realized this was a recommended feature for security. I updated the readme.md to reflect the steps to download the required Python module. This means web server certificates will be validated to mitigate the potential for MITM attachks(Man in the Middle).
    I am not too familiar with what kind of malicious payload could be executed from inside an image if any. I do recall an art known as steganography whereby secret messages are somehow hidden into an image. Perhaps, it could be via metadata or patterns but it pretty interesting methodology.
- Get File Hash Function
    This function facilitates obtaining local and remote file hashes which will facilitate minimizing the data duplication as stated previously. It has yet to be fully tied in but I did test on one of 
- Batch Operations
    Considering the 10 resteem quota was met, I have my work cut out for me. Instead of onsie twosies, I decided to modify things into a function that can receive accounts or account as the paramater. If accounts are not specified in the script, the typical user prompt will occur. This will hopefully make obtaining everybody else's backup less time intensive.
Looking forward to completed the backups for 
P.S. I'm gonna need to mount a new VHD to my VM. I checked and had 4 GBs left. Whew!
Thanks for stopping by!
How to put your FREE Downvotes to work in 2 easy steps!
This post was created using the @eSteem Desktop Surfer App.
    They also have a referral program that promotes users to onboard to our great chain. Sign up using my referral link to help support my efforts to improve the Steem blockchain.
Ditch Partiko and get eSteem today!
| PlayStore - Android | Windows, Mac, Linux |
|---|---|
 |
 |
| AppStore - iOS | Web |
 |
 |