Go to Post Intent is determined by those that are doing, not those that are watching. - meaubry [more]
Home
Go Back   Chief Delphi > Technical > Programming
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Closed Thread
 
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 09-09-2004, 15:38
Fulcrum2000 Fulcrum2000 is offline
Registered User
no team
 
Join Date: Sep 2004
Location: Netherlands
Posts: 7
Fulcrum2000 can only hope to improve
Re: New compression method

Quote:
Originally Posted by Aalfabob
Ive checked a couple of the files after a couple of runs by hand to see if the data is coming out right and everything seems fine. Thats about it for now.
Sounds good, my 10000 dollar offer is still valid...
  #2   Spotlight this post!  
Unread 09-09-2004, 18:59
FizMan's Avatar
FizMan FizMan is offline
aboot, eh?
AKA: Chris Sinclair
#0783 (Mobotics)
Team Role: Alumni
 
Join Date: Feb 2004
Location: Toronto, Canada
Posts: 102
FizMan will become famous soon enough
Send a message via AIM to FizMan Send a message via MSN to FizMan
Re: New compression method

So Aalfa, do you take certified cheques/money order or have paypal? roffle
__________________
Joules per second! Watt? Joules per second! Watt? Jouls per second! Watt?
  #3   Spotlight this post!  
Unread 09-09-2004, 23:20
Aalfabob's Avatar
Aalfabob Aalfabob is offline
Registered User
#0201 (FEDS)
 
Join Date: Sep 2004
Rookie Year: 2004
Location: Rochester, MI
Posts: 27
Aalfabob is on a distinguished road
Send a message via AIM to Aalfabob
Re: New compression method

Please correct me if im worng but I think this can help prove it a little better:

So say I have 512 bytes of data im compressing. This can contain 3.74 * 10^693 different combinations correct? So say I add a byte to that (513 Bytes), the combinations that creates are 6.16 * 10^693 or twice as much.

So say I have one byte as a header that can count the amount of times that data has been compressed. So that header can hold 256 values. So depending on which way those bytes come out (3.74 * 10^693), the counter can hold 256 different values so wouldnt adding that 1 byte for counting actually make the file have 9.57 * 10^695 combinations (256 * (3.74 * 10^693))? Now this is alot more combinations avaliable for the same amount of data. Hopefully I did that right.

Data:
512 byte combinations = 3.74 * 10^693
513 byte combinations = 6.16 * 10^693
513 with one byte being a counter = 9.57 * 10^695

If im correct i think that this can prove that that many pieces of randomly generated code can fit in that space. And plus im using a 2 byte main header which can contain 65536 runs.
  #4   Spotlight this post!  
Unread 09-09-2004, 23:48
MrToast's Avatar
MrToast MrToast is offline
I named Greg Needel's cat!
AKA: Dave DeLong
no team (Rhode Warriors)
Team Role: Alumni
 
Join Date: Mar 2004
Rookie Year: 2004
Location: RI, now UT
Posts: 326
MrToast has much to be proud ofMrToast has much to be proud ofMrToast has much to be proud ofMrToast has much to be proud ofMrToast has much to be proud ofMrToast has much to be proud ofMrToast has much to be proud ofMrToast has much to be proud of
Send a message via AIM to MrToast
Re: New compression method

Any chance of a Mac OS X compile? Interestingly enough, I'm also collaborating with a friend in producing a new compression scheme that uses recursive compression. Don't ask me about it, though. I'm just building the interface.

mrtoast@gmail.com

MrToast

[edit] 121st post! Go Rhode Warriors![/edit]
__________________
(#121, 2004) Archimedes semi-finalists with 237 and 386! I had an awesome time guys, and thanks for the hat!
(#121, 2004) BC5 semi-finalists with 190 and 1027! Awesome time! We went further than I thought we could! Thanks for all your help w/ our transmission!
(#121, 2005) Galileo quarter-finalists with 47 and 203! Thanks for all your support through the stress!
------------------------------
If it moves and it shouldn't, use duct tape.
If it doesn't move and it should, use WD-40
------------------------------
"It'll all work out in the end, and if it doesn't, it's not the end." - Jeff Bullock
  #5   Spotlight this post!  
Unread 10-09-2004, 00:03
rbayer's Avatar Unsung FIRST Hero
rbayer rbayer is offline
Blood, Sweat, and Code
no team (Teamless Orphan)
 
Join Date: Mar 2002
Rookie Year: 2001
Location: Minnetonka, MN
Posts: 1,087
rbayer is a glorious beacon of lightrbayer is a glorious beacon of lightrbayer is a glorious beacon of lightrbayer is a glorious beacon of lightrbayer is a glorious beacon of light
Send a message via AIM to rbayer
Re: New compression method

Quote:
Originally Posted by Aalfabob
Please correct me if im worng but I think this can help prove it a little better:

So say I have 512 bytes of data im compressing. This can contain 3.74 * 10^693 different combinations correct? So say I add a byte to that (513 Bytes), the combinations that creates are 6.16 * 10^693 or twice as much.

So say I have one byte as a header that can count the amount of times that data has been compressed. So that header can hold 256 values. So depending on which way those bytes come out (3.74 * 10^693), the counter can hold 256 different values so wouldnt adding that 1 byte for counting actually make the file have 9.57 * 10^695 combinations (256 * (3.74 * 10^693))? Now this is alot more combinations avaliable for the same amount of data. Hopefully I did that right.

Data:
512 byte combinations = 3.74 * 10^693
513 byte combinations = 6.16 * 10^693
513 with one byte being a counter = 9.57 * 10^695

If im correct i think that this can prove that that many pieces of randomly generated code can fit in that space. And plus im using a 2 byte main header which can contain 65536 runs.
It doesn't matter _what_ is stored in that extra byte. It's still just 8 bits. Adding 1 more byte, regardless of contents, always gives you 256 (that's 2^8) times as many possible combination. A bit, is a bit, is a bit, regardless of how your program interprets it. Also, keep in mind that 2^4096 (4096 is the number of bits in 512 bytes, so 2^4096 is the number of different possible 512-byte files) is still _astronomically_ smaller than 2^8388608, the number of different possible 1MB file. I really can't stress this enough: it has been _proven_ that you cannot compress every file of a given size down to a file smaller than the original (even if only by 1 bit). This has been PROVEN. Trying to do it is basically the same as trying to find an O(n) sorting algorithm (proven to be impossible) or trying to solve the halting problem (also proven impossible). While you're at it, why don't you find an integer solution to x^3 + y^3 = z^3.

Also, I _love_ math and arguing about math, etc, but _please_ use 2^x instead of 10. With binary stuff it makes it SO much easier to understand what's actually going on.

Rob
__________________
New C-based RoboEmu2 (code simulator) available at: http://www.robbayer.com/software.php
  #6   Spotlight this post!  
Unread 10-09-2004, 00:20
Max Lobovsky's Avatar
Max Lobovsky Max Lobovsky is offline
Fold em oval!
FRC #1257 (Parallel Universe)
Team Role: College Student
 
Join Date: Jan 2004
Rookie Year: 2004
Location: Scotch Plains, NJ
Posts: 1,026
Max Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant futureMax Lobovsky has a brilliant future
Send a message via AIM to Max Lobovsky
Re: New compression method

Quote:
Originally Posted by Aalfabob
Please correct me if im worng but I think this can help prove it a little better:

So say I have 512 bytes of data im compressing. This can contain 3.74 * 10^693 different combinations correct? So say I add a byte to that (513 Bytes), the combinations that creates are 6.16 * 10^693 or twice as much.

So say I have one byte as a header that can count the amount of times that data has been compressed. So that header can hold 256 values. So depending on which way those bytes come out (3.74 * 10^693), the counter can hold 256 different values so wouldnt adding that 1 byte for counting actually make the file have 9.57 * 10^695 combinations (256 * (3.74 * 10^693))? Now this is alot more combinations avaliable for the same amount of data. Hopefully I did that right.

Data:
512 byte combinations = 3.74 * 10^693
513 byte combinations = 6.16 * 10^693
513 with one byte being a counter = 9.57 * 10^695

If im correct i think that this can prove that that many pieces of randomly generated code can fit in that space. And plus im using a 2 byte main header which can contain 65536 runs.
No, you are not correct, there are 2^8=256 times as many 513 byte sets as 512 byte sets, not twice as many, just as many combinations as a one byte header adds... There really is absolutely no argument, you cannot consistently store a file in a space smaller than that file, otherwise you wouldn't be able to store all possible files...
__________________
Learn, edit, inspire: The FIRSTwiki.
Team 1257


2005 NYC Regional - 2nd seed, Xerox Creativity Award, Autodesk Visualization Award
2005 Chesapeake Regional - Engineering Inspiration Award
2004 Chesapeake Regional - Rookie Inspiration award
2004 NJ Regional - Team Spirit Award
  #7   Spotlight this post!  
Unread 10-09-2004, 10:07
Mark McLeod's Avatar
Mark McLeod Mark McLeod is online now
Just Itinerant
AKA: Hey dad...Father...MARK
FRC #0358 (Robotic Eagles)
Team Role: Engineer
 
Join Date: Mar 2003
Rookie Year: 2002
Location: Hauppauge, Long Island, NY
Posts: 8,725
Mark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond reputeMark McLeod has a reputation beyond repute
Re: New compression method

The judgment might be being made among some of you that the algorithm is automatically a failure since it cannot possibly compress all possible combinations of files to 515 bytes. The algorithm doesn’t have to be equally successful with compressing every class of file, and they don’t all have to be reduced to 515 bytes to be considered successfully compressed. The most “successful” compression technology becomes so by specializing in one class of file or another, e.g., imagery, text, object, and executable files. Our friend here hasn’t yet had the opportunity to run rigorous tests on the wide variety of files within even one class yet to discover the limitations of his algorithm.

This is a learning experience in developing an algorithm. Everyone can help as independent testers, with developing test procedures, mathematical proofs, test sets, critique, etc. Just keep it positive. The mathematical reasoning posted above is very good experience for Aalfabob and for any of us for the type of proof that will be required whenever you develop a commercially viable algorithm.

Don’t be discouraged to uncover shortcomings of your method.
__________________
"Rationality is our distinguishing characteristic - it's what sets us apart from the beasts." - Aristotle

Last edited by Mark McLeod : 10-09-2004 at 11:56.
  #8   Spotlight this post!  
Unread 10-09-2004, 15:09
Aalfabob's Avatar
Aalfabob Aalfabob is offline
Registered User
#0201 (FEDS)
 
Join Date: Sep 2004
Rookie Year: 2004
Location: Rochester, MI
Posts: 27
Aalfabob is on a distinguished road
Send a message via AIM to Aalfabob
Re: New compression method

Isnt the formula combinations = bytes ^ values

so like a 512 byte peice of data ^ 256 possible charactors = 3.742e+693 combinations?

edit - Nm got the wrong formula from someone.

Last edited by Aalfabob : 10-09-2004 at 15:34.
  #9   Spotlight this post!  
Unread 10-09-2004, 16:10
Rickertsen2 Rickertsen2 is offline
Umm Errr...
None #1139 (Chamblee Gear Grinders)
Team Role: Alumni
 
Join Date: Dec 2002
Rookie Year: 2002
Location: ATL
Posts: 1,421
Rickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant futureRickertsen2 has a brilliant future
Send a message via AIM to Rickertsen2 Send a message via Yahoo to Rickertsen2
Re: New compression method

Quote:
Originally Posted by Aalfabob
Isnt the formula combinations = bytes ^ values

so like a 512 byte peice of data ^ 256 possible charactors = 3.742e+693 combinations?

edit - Nm got the wrong formula from someone.
The formula for the number of discrete combinations that can be stored in a binary number of length X bits is simply:

2^x

Regardless of how you group these bits or your program interprets them, you will always be limited by this fomula.
__________________
1139 Alumni
  #10   Spotlight this post!  
Unread 10-09-2004, 16:40
wun's Avatar
wun wun is offline
Registered User
AKA: David Wolever
#0865 (Warp7)
Team Role: Programmer
 
Join Date: Dec 2003
Rookie Year: 2001
Location: Toronto
Posts: 84
wun will become famous soon enough
Send a message via AIM to wun Send a message via MSN to wun
Re: New compression method

The one thing I have been wondering is if your magical algorithm calls on outside data (EG: using a dictionary outside the "compressed" file)?
__________________
Help Microsoft stop piracy. Use Linux!

I have three gmail invitations, message me if you want one
  #11   Spotlight this post!  
Unread 10-09-2004, 16:48
rbayer's Avatar Unsung FIRST Hero
rbayer rbayer is offline
Blood, Sweat, and Code
no team (Teamless Orphan)
 
Join Date: Mar 2002
Rookie Year: 2001
Location: Minnetonka, MN
Posts: 1,087
rbayer is a glorious beacon of lightrbayer is a glorious beacon of lightrbayer is a glorious beacon of lightrbayer is a glorious beacon of lightrbayer is a glorious beacon of light
Send a message via AIM to rbayer
Re: New compression method

Quote:
Originally Posted by Aalfabob
Isnt the formula combinations = bytes ^ values

so like a 512 byte peice of data ^ 256 possible charactors = 3.742e+693 combinations?

edit - Nm got the wrong formula from someone.
Close, but not quite. If you want to think of it that way, it's actually 256 ^ 512. Think about it this way: there are 256 possiblities for the first byte, times 256 for the second, times 256 for the third, etc, etc. Thus, you get 256*256*256*... = 256 ^ 512.
__________________
New C-based RoboEmu2 (code simulator) available at: http://www.robbayer.com/software.php
  #12   Spotlight this post!  
Unread 10-09-2004, 17:15
piotrm's Avatar
piotrm piotrm is offline
Registered User
AKA: Piotr Mardziel
FRC #0190 (Gompei and the HERD)
Team Role: College Student
 
Join Date: Dec 2002
Rookie Year: 2001
Location: Dudley, MA
Posts: 96
piotrm has a spectacular aura aboutpiotrm has a spectacular aura about
Send a message via AIM to piotrm
Re: New compression method

Wow, I can't believe this thread has been running for this long. From the very first posts it was evident to me that this is a scam. The subtle mentions of financial gain. The need for patent money in order to make the big greens, etc... The interesting part is that one real chief delphi person mentioned that he knows aalfabob of this wonderfull compression scheme.

However, I realize odd things can come together once upon a time and that all of these scam-signs were inadvertent and aalfabob thinks he has this algorithm. If so then I apologize. However, I am 99.999% sure that such a bold compression scheme is impossible as was probably states a few times already in this thread.

On a humorous note: take a look at this http://lzip.sourceforge.net/.

I do so register my vote (opinion) as above on this issue.
  #13   Spotlight this post!  
Unread 10-09-2004, 19:44
Ryan M. Ryan M. is offline
Programming User
FRC #1317 (Digital Fusion)
Team Role: Programmer
 
Join Date: Jan 2004
Rookie Year: 2004
Location: Ohio
Posts: 1,508
Ryan M. has much to be proud ofRyan M. has much to be proud ofRyan M. has much to be proud ofRyan M. has much to be proud ofRyan M. has much to be proud ofRyan M. has much to be proud ofRyan M. has much to be proud ofRyan M. has much to be proud ofRyan M. has much to be proud of
Re: New compression method

Quote:
Originally Posted by piotrm
Wow, I can't believe this thread has been running for this long. From the very first posts it was evident to me that this is a scam. The subtle mentions of financial gain. The need for patent money in order to make the big greens, etc... The interesting part is that one real chief delphi person mentioned that he knows aalfabob of this wonderfull compression scheme.
Well, assuming he is a scammer, all we have to do is wait for his release of the program and he'll expose himself. Don't send him money and you're safe.

Quote:
Originally Posted by poitrm
On a humorous note: take a look at this http://lzip.sourceforge.net/.

I do so register my vote (opinion) as above on this issue.
Wow! Thanks for the link! My computer has sooo much room now that I compressed most of my personal files using lzip. I had done that before using gzip, but lzip was a ton better! Compression is a great thing. Why did you say it was humorous? It seems more amazing than anything to me.


NOTE: I didn't really do this. You shouldn't either.
__________________

  #14   Spotlight this post!  
Unread 10-09-2004, 20:54
J Flex 188's Avatar
J Flex 188 J Flex 188 is offline
"flock their sheep"
AKA: Jeffrey Li
FRC #2505 (The Electric Sheep) & FRC #0188 (Blizzard)
Team Role: Coach
 
Join Date: Feb 2003
Rookie Year: 2003
Location: Toronto
Posts: 457
J Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond reputeJ Flex 188 has a reputation beyond repute
Send a message via ICQ to J Flex 188 Send a message via AIM to J Flex 188
Re: New compression method

"Known issues with lzip 1.0:
Attempting to compress the lzip or lunzip programs themselves will trap your system in an infinite loop, and may cause the platter from your hard disks to shoot out of their drive bays at close to the speed of sound. Attempting to uncompress either of the exectuables will suck your computer into a minature black hole, which we believe from our benchmarks (speculatively) exits in an anitmatter universe parallel to our own. If you are interested in exploring this possibilty, please write to us once you get there. "

off of the download section of the page. he was probably referring to that. I know it gave me a chuckle. hehe. as did the whole program being gzipped. =D


Quote:
Originally Posted by Ryan Morehart
Well, assuming he is a scammer, all we have to do is wait for his release of the program and he'll expose himself. Don't send him money and you're safe.

Wow! Thanks for the link! My computer has sooo much room now that I compressed most of my personal files using lzip. I had done that before using gzip, but lzip was a ton better! Compression is a great thing. Why did you say it was humorous? It seems more amazing than anything to me.


NOTE: I didn't really do this. You shouldn't either.
__________________

Woburn Robotics, Class of 2005.
  #15   Spotlight this post!  
Unread 10-09-2004, 22:54
Aalfabob's Avatar
Aalfabob Aalfabob is offline
Registered User
#0201 (FEDS)
 
Join Date: Sep 2004
Rookie Year: 2004
Location: Rochester, MI
Posts: 27
Aalfabob is on a distinguished road
Send a message via AIM to Aalfabob
Re: New compression method

I had like a 3 paragraph post on how it was putting out smaller files and stuff but the server was down right after i sent it so it was lost.

But anyways, ive decided to let someone take a look at how it works and decide if they think it will work. You guys decide who you think would do the best job and the one I can trust.
Closed Thread


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Compression Crisis reisser 3D Animation and Competition 9 22-02-2004 11:23
IRI Elimination Round Method D.J. Fluck Off-Season Events 19 23-07-2003 18:56
Scouting method suggestiongs punarhero Scouting 0 26-01-2003 04:27
What is your favorite method for attaching gears to shafts? archiver 2001 13 24-06-2002 04:00
CRYSTAL METHOD CONCERT drksdofthemoon Chit-Chat 7 30-04-2002 16:58


All times are GMT -5. The time now is 13:32.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi