Conversation

Notices

1. Lapin (lapin@varishangout.net)'s status on Saturday, 26-Oct-2024 00:02:34 JST Lapin

   just realized the default danbooru parser for hydrus just scrapes the html page instead of using the official API

   damn that’s bad

   • bronze (bronze@pl.kitsunemimi.club)'s status on Saturday, 26-Oct-2024 00:13:44 JST bronze

     in reply to
     @lapin nah thats funny as fuck
     virgin API cuck vs. chad webpage scraper
     :gura_sus: 1e+6 litres :flag_china: likes this.
   • DarkMahesvara (darkmahesvara@varishangout.net)'s status on Saturday, 26-Oct-2024 00:13:48 JST DarkMahesvara

     in reply to

     • bronze
     @bronze @lapin (sc)rape them all :chad0:
     :gura_sus: 1e+6 litres :flag_china: likes this.
   • Lapin (lapin@varishangout.net)'s status on Saturday, 26-Oct-2024 00:17:55 JST Lapin

     in reply to

     lesson learned

     hydrus uses python and thus uses \g<1> instead of the usual pcre’s $1

   • Lapin (lapin@varishangout.net)'s status on Saturday, 26-Oct-2024 00:19:50 JST Lapin

     in reply to

     • bronze

     @bronze
     disagree. dunno about other sites, but danbooru’s rest api is very well documented and easier to reason about

     i’m also kinda biased since i have some experience with it

   • Lapin (lapin@varishangout.net)'s status on Saturday, 26-Oct-2024 00:22:38 JST Lapin

     in reply to

     i forgot a single question mark :bap:

   • Lapin (lapin@varishangout.net)'s status on Saturday, 26-Oct-2024 02:58:10 JST Lapin

     in reply to

     after much trial and error (and somehow missing this part of the documentation), i now understand why the default danbooru parser scrapes the html instead of using the rest api

     hydrus’s limitation means you can’t access other urls when processing the current url, which means no artist notes for you, because the artist commentary is in another endpoint entirely. not the case with the html page obviously. kinda sucks, but oh well

     and because this uses rest api, in order to access posts with banned tags (loli, shota, etc.) i had to override the global http headers (or uses the one inside the url class itself) instead of using my browser’s session id cookies

     anyway, this was quite a fun exercise