Macrobenchmarks: Django + Skybison

[bennn]

Most of the benchmarks so far are tiny! We should try bigger programs.

Ideas:

• Instagram Django benchmark https://github.com/facebookarchive/django-workload (thanks @tekknolagi for the lead)
• the minimal Django benchmark that's in Skybison https://github.com/tekknolagi/skybison/blob/08f3f441eef002602de86641c443287e0b994711/.github/workflows/cmake.yml#L63-L70 (ditto, thanks Max!)

[tekknolagi]

https://github.com/tekknolagi/skybison/blob/08f3f441eef002602de86641c443287e0b994711/.github/workflows/cmake.yml#L63-L70

shows how to set up Django minimal from a pinned version. For your experiment you may want to check in the results so you can incrementally add types and make things static.

[vivaan2006]

Just wanted to put the links to the repos here

1. https://github.com/Instagram/django/tree/master/django

2. https://github.com/tekknolagi/skybison/tree/08f3f441eef002602de86641c443287e0b994711/benchmarks/benchmarks/django

[tekknolagi]

oh the IG Django benchmark I was referring to was https://github.com/facebookarchive/django-workload

[vivaan2006]

Oh ok! Thanks @tekknolagi

[bennn]

to run skybison we may be able to run these commands (from max's link) one by one:

        mkdir -p /var/tmp/django_minimal
        pushd /var/tmp/django_minimal
        ${{github.workspace}}/benchmarks/benchmarks/django/setup_django_minimal.sh
        popd
        ./benchmarks/quickbench/diffrevs.py --run-django HEAD^ HEAD | tee django-benchmark-results.json

but replacing github.workspace with a path to a clone of the skybison repo

[mrigankpawagi]

Hi, I tried to make skybison work (the QuickBench which involved Django). After quite a lot of configurations I had some limited success in setting up the system. However even then it seems cinder python does not work immediately. Since the underlying benchmark itself is quite simple (much like the one in pyperformance), I think we may be better off by creating our own system (since this one has too many moving parts and is quite difficult to debug...).

[mrigankpawagi]

Moreover I want to remind that since we planned to use something like locust, our system might end up much simpler.

[tekknolagi]

I am happy to help out a bit in the next week or two

[mrigankpawagi]

Thanks @tekknolagi, that would be great. Looking forward to hear from you.