Update categories, forums, topics and posts for an already scraped forum. Update the users for an already scraped forum. Scrape categories, forums, topics and posts. Scrape user data from the memberlist and profile pages. $phpbb->forum_logout() $phpbb->get_users() Useful when access is restricted for a guest. Print $phpbb->max_tries, "\n" PUBLIC METHODS $phpbb->empty_tables()Įmpties the tables af a local phpBB installation. If called without a param, they return the value. The accessors have the same name as the constructor parameters. This parameter is not used when updating. The administrator of the local forum will be kept, anything else is deleted. Tables that will be epmtied before scraping. How many parallel processes should be used for fetching. How many times to try fetching a forum page until giving up. The topic id will be inserted with sprintf if "%d" is found. Second part of the topic page link, consisting of GET vars. Defaults to qr/viewtopic.*t=(\d+)/įirst part of the topic page link. Regex for the topic link with the topic id. Regex for the topic link with the post id. Same requirements as for the post date, only that they refer to the registration date as it appears in the memberlist. Month_name - must be one of the values in "months" The number of items must match the number of parantesis in "post_date_format". Position of the elements in the date string. The default is qr/(\w+)\s+(\d+),\s+(\d+)\s+(\d+):(\d+)\s+(\w\w)/ and matches strings like "Tue 5:17 pm" - note that the leading day of the week is ignored as it's not necessary to compute the timestamp. The default is for the english version.ĭate format used in posts. When the storage array reaches this value, the data is commited to the database. Location of the mysql server where the forum will be copied to.ĭatabase with an already installed phpBB forum.Ĭompress mysql trafic (only useful when using a remote server). The current implementation lacks search support, but this can be fixed by converting the forum to phpBB3 or SMF. If used with an administrator name and password it will copy all the member e-mails (not just the public ones) allowing them to request a new random password from the new installation site and continue using the forum. Scraping is possible as a guest or as a loged in member. Make sure the username used during the local installation doesn't exist in the remote forum. It requires a local phpBB2 setup (you can download the old 2.x versions from ) that will be overwritten and it can only access what is available to the web browser (i.e. This module can be used to scrape a phpBB2 instalation using the web interface. Quote_string => "hat folgendes geschrieben", $phpbb->update_forum_common() FANCY EXAMPLE use WWW::phpBB # $phpbb->update_overwrite(1) # don't try to keep modified data # update an already scraped forum, maybe as a daily cron job # login to access the private memberlist and some private forums # scrape a german forum with a non-standard date format and a custom GET var That last one is currently 57 pages, and after you peruse the first couple you can probably skip to about page 55 to get to what's been posted in the last month.WWW::phpBB - phpBB2 forum scraper SYNOPSIS use WWW::phpBB Here are some other relevant threads there you might find useful So you might want to bookmark it for future reference. The peacock thread is getting harder to find there because it's mentioned in so many other threads that searching for it gets over 6000 results and it doesn't appear in the first page of them. Which is patched for the milw0rm exploit. Though the 'peacock thread' ( ) says to use And type in WRT54G2 that should narrow down the choices to 1.Ĭlick on that and it says the latest BrainSlayer product (SP2 build 12533) should be found at
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |