Windows Calculator Scientific Notation Limit

Toggle sidebar Toggle sidebar
S

sharkeeper

Lifer
Jan 13, 2001
10,886
2
0
Is there a limit?

I was working with a large number (143,000+ digits) and hit the n! key! I figured I'd let it go until it finished and that was over 5 hours ago, one CPU is at 100% working the problem! :)

-DAK-
 
N

notfred

Lifer
Feb 12, 2001
38,241
4
0
the windows calculator does not accept numbers longer than 32 digits. I don't know how in the hell you think you got 143,000 digits in there.
 
Bignate603

Bignate603

Lifer
Sep 5, 2000
13,897
1
0
Well, if you think about it, the maximum number a 32 bit processor can handle in one chunk is 4294967296 in one shot. After that it will need to run a loop to work on larger numbers. I guess you could probably do something to make it run an indefinite loop so it will continue until it runs out of a certain resource. Either that or there is an extremely high limit of the number of times the loop will run so that gives a limit...

This is me just thinking to myself though, I could very well be wrong.
 
S

sharkeeper

Lifer
Jan 13, 2001
10,886
2
0
the windows calculator does not accept numbers longer than 32 digits. I don't know how in the hell you think you got 143,000 digits in there.
Click to expand...

Scientific Notation

-DAK-

Why not RAID5 three mice? You could go twice as fast in a FPS, could stand losing one during battle and with today's fast cpu's, one would not take too much of a hit to calculate cartesian parity. Of course the third hand may be hard...

 
Bignate603

Bignate603

Lifer
Sep 5, 2000
13,897
1
0
Originally posted by: notfred
the windows calculator does not accept numbers longer than 32 digits. I don't know how in the hell you think you got 143,000 digits in there.
Click to expand...

Scientific notation?

Edit: got beat to the punch
 
silverpig

silverpig

Lifer
Jul 29, 2001
27,703
12
81
Originally posted by: shuttleteam
Is there a limit?

I was working with a large number (143,000+ digits) and hit the n! key! I figured I'd let it go until it finished and that was over 5 hours ago, one CPU is at 100% working the problem! :)

-DAK-
Click to expand...

It ain't gonna be finished anytime soon. I just did 25000! and it took about 8-10 seconds I figure.
 
S

sharkeeper

Lifer
Jan 13, 2001
10,886
2
0
Still going! It's gonna need to express the exponent in scientific notation! :Q

Either that or it will never finish. Thank goodness for SMP.

-DAK-
 
You must log in or register to reply here.

TRENDING THREADS

COMPANY
RESOURCES
FOLLOW
Top Bottom