Author Topic: Any Reason This Shouldn't Work? (Read 9549 times)

ztrumpet · « **Reply #30 on:** October 06, 2010, 07:38:01 pm »

Never mind, my code failed.

meishe91 · « **Reply #31 on:** October 06, 2010, 07:40:05 pm »

What was it supposed to do?

ztrumpet · « **Reply #32 on:** October 06, 2010, 07:44:07 pm »

Fail.

No, it was to demonstrate floating point rounding errors. It was simple enough that it didn't work. It should work now.

(Edited)

Deep Toaster · « **Reply #33 on:** October 06, 2010, 07:45:26 pm »

Yeah, the calc only shows 11 digits of accuracy, while it really holds 14

meishe91 · « **Reply #34 on:** October 06, 2010, 11:49:50 pm »

Isn't the error only in the decimal places? Like if you have a fourteen digit number shouldn't it retain those?

Deep Toaster · « **Reply #35 on:** October 06, 2010, 11:54:03 pm »

Yeah. But the point is fPart( often leaves that extra bit of inaccuracy which isn't displayed. They're a pain to debug

meishe91 · « **Reply #36 on:** October 06, 2010, 11:56:03 pm »

Ya, I know, was just making sure

Thanks again guys.

DJ Omnimaga · « **Reply #37 on:** October 07, 2010, 12:05:54 am »

Yeah. But the point is fPart( often leaves that extra bit of inaccuracy which isn't displayed. They're a pain to debug

That reminds me this topic. Is it the same thing?

Deep Toaster · « **Reply #38 on:** October 07, 2010, 12:18:50 am »

It seems to be...