I came across this thread searching Lemmy for another query, and it intrigued me. How does 81 TB of data get scraped without Spotify knowing? That seems like a server administration failure on a large scale. I mean, 81 TB is nothing to dismiss offhand. OTOH, they are probably burning through petabytes daily, but still. IT: ‘I wonder why these few accounts are downloading TB’s of data, daily?’
spotify has a whole economy of bots signing up, uploading fake songs listened by other bots and earning lot of money in the process. I know several people living out of this. A little army of scraper bots is definitely not what they should be the most concerned about.
spotify has a whole economy of bots signing up, uploading fake songs listened by other bots and earning lot of money in the process.
Sure, I understand gaming the system. I have tracks on SoundCloud, and the same economy exists there too. I just do it for fun tho, I’m not interested in any monetary or commercial pursuits. It seems to me tho, that a relatively small number of accounts doing massive scraping would raise an eyebrow or two, no? Roughly, the average a 320 kbps audio track would be around 8 MB +/-, which gives you 10,616,832+/- tracks. Damn!
since botting is so easy, probably they used a lot of accounts to access data that, in theory, is somewhat public. I mean, in an ideal world in which engineers have infinite time sure, they would have noticed, but I do investigations on platform apps for work and trust me, they miss a lot of more fundamental stuff.
I came across this thread searching Lemmy for another query, and it intrigued me. How does 81 TB of data get scraped without Spotify knowing? That seems like a server administration failure on a large scale. I mean, 81 TB is nothing to dismiss offhand. OTOH, they are probably burning through petabytes daily, but still. IT: ‘I wonder why these few accounts are downloading TB’s of data, daily?’
spotify has a whole economy of bots signing up, uploading fake songs listened by other bots and earning lot of money in the process. I know several people living out of this. A little army of scraper bots is definitely not what they should be the most concerned about.
Sure, I understand gaming the system. I have tracks on SoundCloud, and the same economy exists there too. I just do it for fun tho, I’m not interested in any monetary or commercial pursuits. It seems to me tho, that a relatively small number of accounts doing massive scraping would raise an eyebrow or two, no? Roughly, the average a 320 kbps audio track would be around 8 MB +/-, which gives you 10,616,832+/- tracks. Damn!
since botting is so easy, probably they used a lot of accounts to access data that, in theory, is somewhat public. I mean, in an ideal world in which engineers have infinite time sure, they would have noticed, but I do investigations on platform apps for work and trust me, they miss a lot of more fundamental stuff.