run Gratipay 189

[rohitpaulk]

188

[rohitpaulk]

Trying #467 today

[chadwhitacre]

!m @rohitpaulk

I guess I'll let you drive, and watch for pings when you get stuck on perms or whatever?

[rohitpaulk]

Yep, that works :)

[rohitpaulk]

http://inside.gratipay.com/howto/run-payday

[rohitpaulk]

Why doesn't http://inside.gratipay.com/howto/run-payday have any info about our droplet?

[rohitpaulk]

Aha, we run payday locally now eh

(Here's the commit where the docs were changed: 0a9906f)

[rohitpaulk]

Local repo updated, now moving on to migrating tips...

[rohitpaulk]

$ heroku config -s | run_dammit /dev/stdin -c ./env/bin/python ./bin/migrate-tips.py > migrate-tips.log
-bash: run_dammit: command not found

Going to use honcho instead..

[rohitpaulk]

$ heroku config -s -a gratipay | ./env/bin/honcho run -e /dev/stdin ./env/bin/python ./bin/migrate-tips.py > migrate-tips.log

In progress...

[rohitpaulk]

Migrated 0 tip(s) for 'detexify'
'sudomesh' already migrated.
'konlpy' already migrated.
'byebug' already migrated.
Migrated 0 tip(s) for 'shields'
Migrated 0 tip(s) for 'hamper'
Migrated 0 tip(s) for 'juice-shop'
Migrated 0 tip(s) for 'searx'
'md-for-bootstrap' already migrated.
Migrated 0 tip(s) for 'orionjs'
Migrated 0 tip(s) for 'piloting-postdevelopment'
'nim' already migrated.
'tabula' already migrated.
'exercism' already migrated.
'torque3d' already migrated.
Migrated 0 tip(s) for 'meteor-active-route'
'aegirproject' already migrated.
'totalism-hackbase' already migrated.
Migrated 0 tip(s) for 'openlp'
'catapultpgh' already migrated.
'svg-js' already migrated.
Migrated 0 tip(s) for 'rtail'
Migrated 0 tip(s) for 'sean-js'
'rubocop' already migrated.
Migrated 0 tip(s) for 'bootswatch'
'flexget' already migrated.
'trakt-for-plex' already migrated.
'the-perl-review' already migrated.
'pylonsproject' already migrated.
Migrated 0 tip(s) for 'tyf'
Migrated 0 tip(s) for 'hypatia-software-organization'
'nanoc' already migrated.
Migrated 0 tip(s) for 'tech-store-club'
'ucoin' already migrated.
'image-optim' already migrated.
'rhombus-tech' already migrated.
'pageres' already migrated.
'davorg' already migrated.
'fabric-js' already migrated.
'cpan-book' already migrated.
'dreditor' already migrated.
'northern-plains-athletics' already migrated.
'gammu' already migrated.
'the-charis-project' already migrated.
Migrated 0 tip(s) for 'libravatar'
Migrated 0 tip(s) for 'kriasoft'
'webtorrent' already migrated.
'josd' already migrated.
Migrated 0 tip(s) for 'projectcloudly'
Migrated 0 tip(s) for 'junest'
Migrated 0 tip(s) for 'musical-artifacts'
Migrated 0 tip(s) for 'simple-icons'
'drupal-search-api' already migrated.
Migrated 0 tip(s) for 'slap'
Migrated 0 tip(s) for 'flexible-grid-system'
Migrated 0 tip(s) for 'weblog-sh'
'sailor' already migrated.
Migrated 0 tip(s) for 'liboctavo'
'debian-lts-by-freexian' already migrated.
'mojolicious' already migrated.
'teampopong' already migrated.
'cpan-io' already migrated.
'doit' already migrated.
'devdocs' already migrated.
'cuberite' already migrated.
'encommuns' already migrated.
'perlweekly' already migrated.
'json-resume' already migrated.
'org-mode' already migrated.
'weblate' already migrated.
'perl-maven' already migrated.
'the-mountain-spirit' already migrated.
Migrated 0 tip(s) for 'hunter'
Migrated 0 tip(s) for 'ng-file-upload'
Migrated 0 tip(s) for 'code-for-seoul'
'act' already migrated.
'knopproject' already migrated.
'grip' already migrated.
Migrated 0 tip(s) for 'coala'
'opencv' already migrated.
Migrated 0 tip(s) for 'vegeta'
Migrated 0 tip(s) for 'kivy'
'magit' already migrated.
'introtopython' already migrated.
Migrated 0 tip(s) for 'concrete-clouds'
Migrated 0 tip(s) for 'funcool'
'fsnotify' already migrated.
'citizens-network' already migrated.
'cider' already migrated.
'zed' already migrated.
Migrated 0 tip(s) for 'matlab-schemer'
Migrated 0 tip(s) for 'toolitup'
Migrated 0 tip(s) for 'vanilla-music'
Migrated 0 tip(s) for 'yawttk'
Migrated 0 tip(s) for 'cdnjs'
Migrated 0 tip(s) for 'wallabag'
'esdiscuss' already migrated.
'sublimelinter' already migrated.
Migrated 0 tip(s) for 'share-term'
'civicrm-lts' already migrated.
'webpack' already migrated.
'contribkanban-com' already migrated.
Migrated 0 tip(s) for 'botwiki-org'
Migrated 0 tip(s) for 'tipsy'
Migrated 0 tip(s) for 'brainfock'
Migrated 0 tip(s) for 'chameleon'
Migrated 0 tip(s) for 'gryd'
'dokku' already migrated.
Migrated 0 tip(s) for 'retrospring'
'grimoire' already migrated.
Migrated 0 tip(s) for 'itcase'
Migrated 0 tip(s) for 'sharex'
Migrated 0 tip(s) for 'drupal-media-youtube-upload'
Migrated 0 tip(s) for 'coinvest'
Migrated 0 tip(s) for 'os-js'
'pjf' already migrated.
'bevry' already migrated.
Migrated 0 tip(s) for 'radiant-player'
Migrated 0 tip(s) for 'macdown'
Migrated 0 tip(s) for 'phanbook'
'cappuccino' already migrated.
Migrated 0 tip(s) for 'jeto'
'sudo-room' already migrated.
Migrated 0 tip(s) for 'youtransfer-io'
Migrated 0 tip(s) for 'flamecore'
'minotar' already migrated.
Migrated 0 tip(s) for 'poll'
'jshttp' already migrated.
Migrated 0 tip(s) for 'jsfile'
'duo' already migrated.
Migrated 0 tip(s) for 'flif'
'simplytest-me' already migrated.
'pariskiwi' already migrated.
Migrated 0 tip(s) for 'decent-im'
'endless-parentheses' already migrated.
'reddit-enhancement-suite' already migrated.
Migrated 0 tip(s) for 'neocities'
'cyberpipe' already migrated.
'wdrl' already migrated.
Migrated 0 tip(s) for 'asciinema'
'gkz-open-source' already migrated.
'chocolatey' already migrated.
Migrated 0 tip(s) for 'pomodoro-cc'
'pillow' already migrated.
Migrated 0 tip(s) for 'horizon-launcher'
'nuvola-player' already migrated.
'sqlalchemy' already migrated.
'jsbin' already migrated.
'Gratipay' already migrated.
Done.

[rohitpaulk]

That script spent 5 minutes and we migrated 0 tips :P

[rohitpaulk]

Downloading backup..

[rohitpaulk]

Okay I don't really understand how bin/snapper.py works, so I'm doing this manually

[rohitpaulk]

$ pg_restore --verbose --clean --no-acl --no-owner --jobs 8 -d gratipay ../backups/b268.dump

[rohitpaulk]

Since I have multiple heroku remotes in the same directory, I had to change -a gratipay to the heroku config command

[rohitpaulk]

Why should we take a backup at all if this is happening via the heroku config?

[rohitpaulk]

Anyway... Now for the real deal

[chadwhitacre]

[rohitpaulk]

We're done! Script ran for 8 minutes

[rohitpaulk]

Now to run masspay...

[rohitpaulk]

Aha, first roadblock. Paypal permission... @whit537

[chadwhitacre]

Sir!

[rohitpaulk]

I don't have access to the meldium account either...

[chadwhitacre]

I'm looking at PayPal to see the best way to share creds.

What do you need the Medium account for?

[rohitpaulk]

I thought that it'd have paypal credentials in there...

[chadwhitacre]

I'm confused ... PayPal credentials in Medium?

[rohitpaulk]

Isn't meldium a password manager?

[rohitpaulk]

MELDIUM, not MEDIUM

[rohitpaulk]

Wait, don't we use meldium? I remember seeing it mentioned somewhere

[rohitpaulk]

https://github.com/gratipay/logs/commit/d51ce4bbaace40b0653ea4550a114cbe25dca4fb

Used Github's commit UI for the first time 💃

[chadwhitacre]

Ah, nice! :-)

Okay! Where are we? I shuffled escrow a bit, so I think we're done with PayPal ...

[chadwhitacre]

/me goes back to eating popcorn. :]

[rohitpaulk]

[rohitpaulk]

11% decline rate (6/54)

[rohitpaulk]

Post mortem.. @whit537 Why are we using backups at all?

[rohitpaulk]

AFAICT - All of our commands hit Heroku directly

[rohitpaulk]

I don't have the time right now, but I'll edit the scripts soon to add -a gratipay to all the heroku commands.

[chadwhitacre]

Why are we using backups at all?

I guess we don't have our backup policies documented anywhere, but it seems like a good idea to me to have a backup somewhere outside of Heroku. Payday seems like a natural time to take said backup. No?

[chadwhitacre]

The practice was also more relevant earlier on, when payday errors would sometimes corrupt the database.

[rohitpaulk]

It makes sense if the backups are stored somewhere (like S3), yes. For now, I think triggering a backup on Heroku just before running the script should suffice :)

when payday errors would sometimes corrupt the database.

Ah, yes.

[chadwhitacre]

@rohitpaulk I've been storing the backups on an external hard drive.

[chadwhitacre]

But we could desync that from payday.

[rohitpaulk]

Sneaky!

[chadwhitacre]

I'm caught! :-)

[chadwhitacre]

Maybe that deserves a reticket? Reviewing and formalizing our backup policies?

[chadwhitacre]

Or data management more broadly?

[chadwhitacre]

11% decline rate (6/54)

It's actually 10% (6 / 60).

[chadwhitacre]

I believe we missed https://gratipay.com/dashboard/1.0-payouts and probably https://gratipay.com/dashboard/ (hard to tell on that one ;-).

[chadwhitacre]

Going to use honcho instead..
Since I have multiple heroku remotes in the same directory, I had to change -a gratipay to the heroku config command

Tweaked in 65ceb75.

[mattbk]

That script spent 5 minutes and we migrated 0 tips :P

:-(

[chadwhitacre]

!m @rohitpaulk :-)