Tilted Forum Project Discussion Community  

Go Back   Tilted Forum Project Discussion Community > The Academy > Tilted Knowledge and How-To


 
 
LinkBack Thread Tools
Old 06-05-2003, 10:49 PM   #1 (permalink)
I run E.
 
Location: New York
Download a site...

Is there a way/program to save a site(links and everything intact) to be used offline?
Would this work with the TFP?
How big do you think the TFP is in Gigs?
__________________
I hold with those that favor fire.

Last edited by eyeronic; 06-06-2003 at 05:37 AM..
eyeronic is offline  
Old 06-06-2003, 01:04 PM   #2 (permalink)
Know Where!
 
MacGnG's Avatar
 
there aren't any programs i know of that would work with TFP because it uses cookies, etc.. but there are MANY programs that can be used to simply download everything from a URL, imput url and it just starts to download any and all links from it (better progz have better configs, etc..) but u get the idea

try download.com or something like that
MacGnG is offline  
Old 06-06-2003, 03:29 PM   #3 (permalink)
Junkie
 
Stiltzkin's Avatar
 
You know, this reminds me of some site I found a while ago operated by some university. They have a seriously massive database cataloging the entire internet for each year, so you can actually go back and see what the internet looked like in say, 1997. I know I posted about it at the http://www.fanimenation.com/ forums a looong time ago. Now I'm going through all the threads to try to find it.
__________________
The most important thing in this world is love.
Stiltzkin is offline  
Old 06-07-2003, 07:13 AM   #4 (permalink)
Loser
 
Location: Chicago
depending on how much you're actually trying to save, try going to FILE then SAVE AS.........i know it will save the current page and all graphics on it, not sure if you will be able to do a WHOLE site. this is my second day here and as far as i know TFP is using
some massive space....that TT board is pretty stocked up with graphics.

ah yes..........check this link
http://download.com.com/3000-2381-10...l?tag=lst-0-17

Last edited by Redirect; 06-07-2003 at 07:16 AM..
Redirect is offline  
Old 06-07-2003, 07:09 PM   #5 (permalink)
MSD
The sky calls to us ...
 
MSD's Avatar
 
Super Moderator
Location: CT
The site that archives the whole internet is www.archive.org

It only catches the front page of TFP. As for saving to disk, I recall Sty saying last week that the database passed the 2GB mark. The problem that you would probably have is that certain information (hidden email addresses in TFP, Admin areas of most sites, etc.) are set to restricted viewing rights. Anything that tried to save everything to disk would get horribly confused by the TFP, and also suck down a whole hell of a lot of bandwidth (which does not make administrators happy. )
MSD is offline  
Old 06-08-2003, 12:06 PM   #6 (permalink)
I run E.
 
Location: New York
MrSelfDestruct: I just started thinking about this because I was rememebering how sad the loss of the last TFP was. Is there a backup system this time? A backup server? The whole thing is only 2 gigs?
__________________
I hold with those that favor fire.
eyeronic is offline  
Old 06-21-2003, 01:44 AM   #7 (permalink)
Crazy
 
Great tip guys thanks
geeza is offline  
Old 06-25-2003, 09:49 PM   #8 (permalink)
Upright
 
Agreed. Awesome, very useful.
etrick is offline  
Old 07-05-2003, 06:22 PM   #9 (permalink)
is a shoggoth
 
Location: LA
I don't know what I would do in the windows world, but if you can get your hands on a unix running computer (not to hard in these days of linux and free software) the program you want is called curl (wget would also work but not as well for this task) you would need to play with it a little so that it sent the right cookies and post data, but all of that can be done pretty easily through command line options. In theory you could get everything that you have accsess to as a user, it would probably take about 2 hours of fiddleing with to do. The other option is just to ask the admin to send you a copy of the sight ziped up in one big file and then encripted with a public key so you couldn't go rooting around thru private data. Then the admin just needs to find somewhere safe to keep his (private) key and he can recover from you whenever he wants. Aw hell screw public key, he could just use a cypher for it and that would work plenty fine, just never gives you the cypherkey.
__________________
Use the star one and you'll be fighting off the old ones with your bare hands
-A Shoggoth on the Roof
giblfiz is offline  
Old 07-07-2003, 11:09 AM   #10 (permalink)
Crazy
 
Under windows, you can use the Windows port of wget to do something like this.

http://space.tin.it/computer/hherold/

Just read through the manual. The administrators of the forum might not like you much if you tried to download the entire forum, but it should be possible. You can also use rate limiting, and you should be able to save the pictures. Also, if you use Netscape/Mozilla you should be able to use the cookies.txt generated by the browser to allow wget to act as if it is logged in. I am not sure if you can do that with IE.
nulltype is offline  
Old 07-12-2003, 05:21 PM   #11 (permalink)
Crazy
 
Location: East Tennessee
I use webreaper it is great and it allows you to get the information in threads you only go into the site as deep as you want to.

I don't remember the site I got it from but it was free.
mvassek is offline  
Old 07-15-2003, 09:54 AM   #12 (permalink)
smithja0423
Guest
 
Quote:
Originally posted by Redirect
....that TT board is pretty stocked up with graphics.
Remember newbies. Most of the images on the titty board are stored on peoples private hosts, so the overall size of the TFP isn't incredibly large. It's big, but it's not terabyte big.
 
Old 09-22-2003, 09:38 PM   #13 (permalink)
2+2=5? Not again!
 
MichaelFarker's Avatar
 
Location: Dallas, Texas
WinHTTrack is free and works well.
MichaelFarker is offline  
Old 10-03-2003, 05:12 PM   #14 (permalink)
Upright
 
it would be cool to have a program like that
aryan is offline  
Old 10-04-2003, 03:24 PM   #15 (permalink)
Crazy
 
AxelF's Avatar
 
Location: Europe
I used WebCopier to download a site about Prague to my laptop before I went there. It was very useful in the hotel room.

BUT it took me DAYS of downloading on my broadband. DAYS! The project will not be letting you browse it until it is finnished or you stop it. Beacause not until then will it convert all the links to local links, which again took hours. But it worked, and it took gigs of space. (turned out to include tons of pictures of the local hookers that I could have been without)

NOTE: a lot of owners of sites do not like (understatement) you to use these robot downloaders and may spank you for it. I am not sure that it would be liked if you try to image this site locally... I would not risk my membership here trying. It may be against the rules in the charter if I am not remembering wrong. So ask first!
__________________
Coffee
AxelF is offline  
Old 10-05-2003, 03:43 AM   #16 (permalink)
Insane
 
Location: SLC, UT
i use wget

google for it
__________________
<Arcane> so if you banged 2000 chicks then at least one had a pen0r?
arcane is offline  
Old 10-08-2003, 06:35 PM   #17 (permalink)
We can't stop here! This is bat country!
 
chewybaca96's Avatar
 
Location: SL,UT
WinHTTrack website copier is a good one.

http://www.httrack.com
__________________
Brian: “Ok, all we’ve gotta do is find the American Embassy, and they’ll help us get home”
Stewie: “Home? I have no intention of returning to that disgusting hovel with that intolerable woman, that fat slob, and that insufferable dog… Oh, you’re right here aren’t you? Oh well, I stand by it."
chewybaca96 is offline  
Old 10-09-2003, 03:26 PM   #18 (permalink)
Psycho
 
Location: San Francisco
Hell I think Frontpage had a feature like that way back when. Not that I would recommend buying it. I remember using it back in the mid to late 90's sometime.
__________________
"If something has to give then it always will."

-- Editors
Nazggul is offline  
Old 10-11-2003, 07:09 PM   #19 (permalink)
Darth Papa
 
ratbastid's Avatar
 
Location: Yonder
I could whack ya up something in Perl in about half an hour.
ratbastid is offline  
 

Tags
save, site

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -8. The time now is 04:25 PM.

Tilted Forum Project

Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2020, vBulletin Solutions, Inc.
Search Engine Optimization by vBSEO 3.6.0 PL2
© 2002-2012 Tilted Forum Project

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360