Commit Graph

79 Commits

Author SHA1 Message Date
Dirk Engling f22a20de6a Enable limiting fullscrapes to only every 5 minutes per IP 2009-08-29 13:55:57 +00:00
Dirk Engling 6062c3afd2 Introduce the concept of an ot_net into opentracker. 2009-08-26 17:37:24 +00:00
Dirk Engling 1e8b74da9a Log networks in its old form has been disabled. Live logging may come back soon. 2009-06-15 14:40:36 +00:00
Dirk Engling a4af3583f2 Fix white spaces
Introduce loading tracker states with -l
Alter tracker state to a human readable form
2009-03-17 23:57:19 +00:00
Dirk Engling abe840d529 Add a stat option the count bucket stalls
Add an iterator for all torrents. It's slower but for stats it's okay.
Move some stats collection stuff to the new iterator. More to come.
Start a "report all stats" page.
Start fixing the code to identify "busy" networks.
Add the concept of hosts allowed to proxy.
Add a parser for the X-Forwarded-For: HTTP header.
Clean up HTTP Header handling code. (Remove some left overs of now vanished sync code).
2009-03-04 14:35:21 +00:00
Dirk Engling bd44fd7c4d Remove superfluous test for == NULL, when variable has been used, anyway 2009-03-03 01:22:50 +00:00
Dirk Engling 4e7e39dc1c Use a self pipe to wake from io_wait when a thread finished his work. 2009-01-16 02:26:50 +00:00
Dirk Engling eb98ff8fe3 We sent an incorrect reply dictionary vor v6 announces 2009-01-15 16:20:18 +00:00
Dirk Engling 6337649b08 V6 2009-01-13 22:41:16 +00:00
Dirk Engling b2ca164922 * http and udp routines now use thread local buffers passed in workstruct containers. In other words they do not use static_buffer anymore and are considered to be thread safe.
* the new workstruct also introduces a well defined buffer and result passing path
* a new function scan_find_keywords is a wrapper around scan_urlencoded_query that maps keys in url to values passed in an array of ot_keywords structs
* this new function cleans up much of url parameter parsing work, where read_ptr and write_ptr have been introduced rather than the confusing char *c, *data variables
* I now use memcmp instead of byte_diff to allow compiler to optimize constant size string compares
* got rid of UTORRENT_1600_WORKAROUND
* livesync_ticker is now only called from one (currently main) thread to avoid race conditions
2009-01-05 18:05:38 +00:00
Dirk Engling 49ec59cbbe * opentracker now drops permissions in correct order and really chroots() if ran as root
* lock passing between add_peer_to_torrent and return_peers_for_torrent is now avoided by providing a more general add_peer_to_torrent_and_return_peers function that can be used with NULL parameters to not return any peers (in sync case)
* in order to keep a fast overview how many torrents opentracker maintains, every mutex_bucket_unlock operation expects an additional integer parameter that tells ot_mutex.c how many torrents have been added or removed. A function mutex_get_torrent_count has been introduced.
2009-01-02 08:57:49 +00:00
Dirk Engling 343169385e Make all torrents in their buckets sorted again. 2008-12-08 02:23:21 +00:00
Dirk Engling 04e5bac4c3 Handle program end more politely 2008-12-07 03:50:47 +00:00
Dirk Engling fa6c870315 Renamed OT_FLAG to OT_PEERFLAG to make code easier to read
Introduced READ16/32 and WRITE16/32 makros to abstract loading/storing from unaligned addresses away on cpu's that can actually load/store everywhere
Removed all unnecessary memmoves, especially where it only moved 6 bytes in inner loop. I replaced them with WRITE16/32(READ16/32()) makros
2008-12-06 18:45:59 +00:00
Dirk Engling a6afcf8ab8 New peer flag to see, whether peer came from announce or sync 2008-12-03 20:39:23 +00:00
Dirk Engling dcf8454138 Live Sync for peers that do not come back too early. 2008-12-01 17:56:53 +00:00
Dirk Engling c0dab929ab The BIG refactoring [tm]. Too many changes to count them. If it doesn't suite you, revert to last version. 2008-11-28 22:21:09 +00:00
Dirk Engling 7dcd727ce6 Whitespace fixes 2008-10-28 01:27:21 +00:00
Dirk Engling 5f7e2dafaa Make ot_try_bind local again. 2008-10-06 02:06:23 +00:00
Dirk Engling e076dab883 added live sync code
added a config file parser
added tracker id
changed WANT_CLOSED_TRACKER and WANT_BLACKLIST into WANT_ACCESS_WHITE and WANT_ACCESS_BLACK
changed WANT_TRACKER_SYNC to WANT_SYNC_BATCH and added WANT_SYNC_LIVE
added an option to switch off fullscrapes

cleaned up many internal hardcoded values, like PROTO_FLAG,
2008-10-04 05:40:48 +00:00
Dirk Engling e767fae72a Introduce some kind of versioning 2007-12-20 05:59:34 +00:00
Dirk Engling 5b3eb23f5f Drop ot_{byte,word,dword} and use uint{8,16,32}_t, also simplify includes 2007-12-03 01:06:33 +00:00
Dirk Engling 7e570f0f60 Fixing mmap allocation went to ot_mutex.c. Clean all torrents moved to ot_clean.c. Also make static buffers static 2007-11-21 01:57:39 +00:00
Dirk Engling f03b2740dd Moving accesslist stuff to its own object 2007-11-12 04:38:43 +00:00
Dirk Engling 0bc163060e Full scrape moves to its own object 2007-11-12 01:38:54 +00:00
Dirk Engling 2e2c1762d3 Move stats out of opentracker.c, also have an own file handle udp requests. 2007-11-06 17:50:41 +00:00
Dirk Engling fed78043a6 No one can get access to buckets now without locking them. Also split up the trackerlogic.c-monster in functional sub-units. HEADS UP: this code is untested and not considered stable. 2007-11-06 11:58:12 +00:00
Dirk Engling 44cbe3de53 Make to_hex thread safe. Get rid off old /24 counting code. Protect more bucket accesses by locks. 2007-11-06 03:21:03 +00:00
Dirk Engling ee8369dbcf We do now use the tools for locking buckets in order to prepare MT code 2007-11-06 01:29:57 +00:00
Dirk Engling aa25c390dd Introducing first tools to make opentracker multithreaded. 2007-11-03 13:43:05 +00:00
Dirk Engling 472f8469d2 Introduce configuration dependent number of parameters in a nicer way 2007-11-02 13:13:03 +00:00
Dirk Engling 1b467d186c Allow for more than one admin ip address 2007-11-01 20:13:03 +00:00
Dirk Engling 66b21d1e28 Add more full scrape stats 2007-10-31 15:39:41 +00:00
Dirk Engling f37e510592 Reenabled syncing 2007-10-29 17:22:05 +00:00
Dirk Engling df30bc8484 Number of buckets is 1024 now
Clean all torrents now only cleans one bucket at a time
All torrents that are being worked upon in an announce are being cleaned on demoand
torrent's peer lists now keep extra counts for seeds and peers to speed up scrape and announce
Sync has gone for now. I will think up a new way to implement. The old one was way to slow.
2007-10-27 14:06:07 +00:00
Dirk Engling d3f8013a18 Introducing multiscrape 2007-10-19 21:56:59 +00:00
Dirk Engling 71436d6b24 After studying opentracker live data, I decided to radically reduce default allocation for vectors and making it grow faster instead: Most pools only had one or two peers, wasting 8*15 or 8*14 bytes. 2007-10-19 14:41:30 +00:00
Dirk Engling 6891fa78bc Increase check interval for timeouted sockets to 10 seconds. That may prevent some disrupted scrapes. 2007-10-19 01:27:23 +00:00
Dirk Engling b61651394a Increase send timeout. Also use an own variable for that. 2007-10-17 23:41:37 +00:00
Dirk Engling 7a3ddcfbce since gettimeofday is rather expansive, we do only fetch time once in a 5 second period, when we are delivered a SIGALRM. 2007-10-13 17:40:37 +00:00
Dirk Engling b3f834951c make 64bit safe 2007-10-12 21:57:10 +00:00
Dirk Engling 4319defc9c New stats for s24s code, this is debug, do not use in real world 2007-09-26 16:49:13 +00:00
Dirk Engling c863c6e108 An announce with event=stopped now returns correct number of leechers and seeders. In TCP and UDP. 2007-09-10 02:43:10 +00:00
Dirk Engling d58db69d9a Added whitelisting to reimplement the WANT_CLOSED_TRACKER functionality 2007-08-18 09:56:22 +00:00
Dirk Engling 6382386416 some subnet stats... still ugly and untested. 2007-07-22 16:17:26 +00:00
Dirk Engling 8ef59b0351 * fixed "nobody " -> "nobody" fuckup when getpwnam-ing
* implemented basic blacklisting:
** the file specified with -b <BLACKLIST> is read and added to a blacklist vector
** if an announce hits a torrent in that blacklist vector, add_peer_to_torrent fails
** sending a SIGHUP to the program forces it to reread the blacklists
** the server returns with a 500, which is not exactly nice but does the job for now
** an adaequat "failure reason:" should be delivered... TODO
2007-07-22 00:40:10 +00:00
Dirk Engling cb90c27b28 Added inbound part of sync. This also meant to remove the black/whitelisting as we did by now. A more scalable way to blacklist will follow. 2007-03-27 16:09:03 +00:00
Dirk Engling 2a646cf4a0 Added outbound part of sync Proposed format: d4:syncd20:<info_hash>8*N:(xxxxyy)*Nee, therefore had to refactor torrent cleanup now that it will hit all torrents once every OT_POOL_TIMEOUT units. 2007-03-27 12:07:29 +00:00
Denis Ahrens b3f72c444b support for udp scrape 2007-03-16 22:46:41 +00:00
Denis Ahrens a45648f301 new modes for udp4 and tcp4 stats 2007-03-15 23:14:14 +00:00