I stole this template

A stew of tiny vegetables:

• They Are Hunted
• <(process substituiton)
• Etsy one-liner
• Apache directory size counter
• strace
• Neilforobot reminders

TheyAreHunted

Problems:

• download urls not easily accessible
• music isn't tagged
• songs might suck (didn't solve)

neat stuff

• WeAreHunted uses a deprecated jQuery library to dynamically build the page and insert giant chunk of JSON
• read the javascript and find the magic url to hit, scrape the javascript out of the page, and start parsing

new problems

• The JSON we ripped out only has a song ID -- something special to WeAreHunted, but not to me/us
• They have a special URL they hit where they give it that ID, and it gives you the download URL
• Cool spy stuff:
  'X-Hunted':'Halt! Who goes there?'
• Use the JSON to tag the songs with the artist and track name.

misc. hunted

• currently 89 lines of Perl
• keeps track of those song IDs in a text file (no duplicates)
• cron runs the script every night
• add a comment tag with the original download date and url (future stats?)
• tiny bash script sucks them down from Linode->macbook once in a while

Process substition in bash

skip making temporary files

• sort file1 | uniq > temp1
• sort file2 | uniq > temp2
• diff temp1 temp2
• rm temp1 temp2
• skip this:
  
  diff <(sort file1 | uniq) <(sort file2 | uniq)

Etsy Stats

Wanted a quick way to see how many people visited the shop and who the top referrer was

• Etsy has an awesome API
• ...execpt for access to stats (none.)
• Pretty stats available on the dashboard

Curl, JSON, and Bash

• Uses curl to sign in on etsy.com and save the cookie to a file. Uses that cookie to access the stats
• Their stats page is all javascript.
• curl hates javascript.
• Found the secret page with that actual information -- all JSON
• JSON perl module:
  
  $stats->{results}{referrers}{sources}[0]{views}{count}

misc. etsy

• All the perl script does is pump out a string
• My /etc/screenrc takes the output of the script and puts it at the bottom of my screen.
• Updates once an hour
• Hasn't sold me any more notebooks

Just show it

abusing the 'at' command

• the 'at' command schedules one-time tasks
• echo 'touch /home/stan/lol' | at 5pm
• Really flexible time syntax

abusing neilforobot

• Special directory contains files that neilforobot should read, say into the channel, then delete.
• "remind me at $1 to $2"
• dangerous to send user input to shell
• remind me at now to rm -rf /
• solution: write the text into a temporary file, then tell 'at' to copy the file to special folder

misc neilforobot

• temporary filename is an md5sum of the user's nickname and current epoch second
• allows people to schedule reminders at the same second for the exact time in the future
• temp files: should move from /tmp to /var/tmp
• meant for files that are temporary, but need to persist across reboots

End!

sources and sources again (re-sources (get it?)(i'm sorry))

• This slide software is from: DZSlides
• This set of slides is from: DCS March 23 2012
• The TheyAreHunted script is available on GitHub at: Stantheman - TheyAreHunted
• Overpriced heart notebooks are still available at: NJ Wooden Books
• View source for image credits