Conversation

Notices

1. :ihavenomouth: (inginsub@clubcyberia.co)'s status on Monday, 30-Oct-2023 06:55:01 JST :ihavenomouth:
   can I scrape fedi with bloat-fe using curl?
   •  (mint@ryona.agency)'s status on Monday, 30-Oct-2023 06:55:00 JST 

     in reply to
     @Inginsub Just query API directly.
   • :ihavenomouth: (inginsub@clubcyberia.co)'s status on Monday, 30-Oct-2023 07:04:07 JST :ihavenomouth:

     in reply to

     • 
     @mint I guess it's more about how to do that in general, when there's no API available
      likes this.
   •  (mint@ryona.agency)'s status on Monday, 30-Oct-2023 07:06:07 JST 

     in reply to
     @Inginsub I imagine you'd want to use some HTML parser like Python's BeautifulSoup.
   • :ihavenomouth: (inginsub@clubcyberia.co)'s status on Monday, 30-Oct-2023 13:42:41 JST :ihavenomouth:

     in reply to

     • 
     @mint parsing HTML in not a problem, I'm trying to curl it with -H "Authorization: Bearer <token>", and it returns the "Error/invalid session" page.
      likes this.
   •  (mint@ryona.agency)'s status on Monday, 30-Oct-2023 13:43:47 JST 

     in reply to
     @Inginsub Sounds like bloat error. You'd have to authorize yourself and use the cookie set by bloat instead.