Separate, but related note: "NYC Open Data" is growing every day & provides free data https://opendata.cityofnewyork.us/ For national data check out the parent organization Socrata.com. Great resources for public data records, which are 100% free, contains everything from real estate transaction...
I have worked on projects handling transfer of large image files across multiple vendors and being served on web for different targets (mobile, web etc.). I have also implemented cloud and DevOps solutions for high volume/scale of data and transactions. While I could tell you a list of technolo...