Use requests_html to implement ComposerPopularityFeature#1018
Use requests_html to implement ComposerPopularityFeature#1018jacobtylerwalls wants to merge 2 commits intocuthbertLab:masterfrom
requests_html to implement ComposerPopularityFeature#1018Conversation
5fa9627 to
975eaab
Compare
html_response to implement ComposerPopularityFeaturerequests_html to implement ComposerPopularityFeature
975eaab to
d1d441f
Compare
This had stopped working because Google's response to the static UserAgent we were giving lacked result counts.
d1d441f to
dddbb93
Compare
|
#846 imports |
|
Never mind -- a google search put me on a fork of the project; the main branch has 11k stars. But its sub requirements are still huge: BS4 is a big file in itself. I think better just to remove the Feature. |
Fixes #907
This had stopped working because Google's response to the static UserAgent we were giving lacked result counts.
I was looking into this package for another reason today and realized it would solve this problem. It rotates user agents. It's owned by PSF. If you don't want to add it to requirements.txt then we can fiddle with the CI script to still have the test run on CI, or we can just deprecate the feature.