Windows Calculator Scientific Notation Limit

sharkeeper

Lifer
Jan 13, 2001
10,886
2
0
Is there a limit?

I was working with a large number (143,000+ digits) and hit the n! key! I figured I'd let it go until it finished and that was over 5 hours ago, one CPU is at 100% working the problem! :)

-DAK-
 

notfred

Lifer
Feb 12, 2001
38,241
4
0
the windows calculator does not accept numbers longer than 32 digits. I don't know how in the hell you think you got 143,000 digits in there.
 

Bignate603

Lifer
Sep 5, 2000
13,897
1
0
Well, if you think about it, the maximum number a 32 bit processor can handle in one chunk is 4294967296 in one shot. After that it will need to run a loop to work on larger numbers. I guess you could probably do something to make it run an indefinite loop so it will continue until it runs out of a certain resource. Either that or there is an extremely high limit of the number of times the loop will run so that gives a limit...

This is me just thinking to myself though, I could very well be wrong.
 

sharkeeper

Lifer
Jan 13, 2001
10,886
2
0
the windows calculator does not accept numbers longer than 32 digits. I don't know how in the hell you think you got 143,000 digits in there.

Scientific Notation

-DAK-

Why not RAID5 three mice? You could go twice as fast in a FPS, could stand losing one during battle and with today's fast cpu's, one would not take too much of a hit to calculate cartesian parity. Of course the third hand may be hard...

 

Bignate603

Lifer
Sep 5, 2000
13,897
1
0
Originally posted by: notfred
the windows calculator does not accept numbers longer than 32 digits. I don't know how in the hell you think you got 143,000 digits in there.

Scientific notation?

Edit: got beat to the punch
 

silverpig

Lifer
Jul 29, 2001
27,703
11
81
Originally posted by: shuttleteam
Is there a limit?

I was working with a large number (143,000+ digits) and hit the n! key! I figured I'd let it go until it finished and that was over 5 hours ago, one CPU is at 100% working the problem! :)

-DAK-

It ain't gonna be finished anytime soon. I just did 25000! and it took about 8-10 seconds I figure.
 

sharkeeper

Lifer
Jan 13, 2001
10,886
2
0
Still going! It's gonna need to express the exponent in scientific notation! :Q

Either that or it will never finish. Thank goodness for SMP.

-DAK-