[metapost] Units unaccuracy with numbersystem set to double

[Daniel H. Luecking]

Friday, April 04, 2014 8:59 AM, Franck Pastor [franck.pastor at mac.com] wrote

>It looks like it is the way to go for the "cm" definition. And "mm" would be 
>ideally defined as 360/127 or cm/10 if I understand correctly…

Since cm is produced from (rounded) calculations of 3600/127, cm/10 would 
be another rounded calculation  on top of that. This has the possibility of 
compounding errors. Better would be mm=360/127, which performs a 
rounded computation of an exact value.

Dan
-- 
Daniel H. Luecking
Department of Mathematical Sciences
University of Arkansas
Fayetteville, Arkansas