Standard ML of New Jersey Change Log

Major revision of the machinery for overloading resolution for both operators (vars) and literals, now using a common mechanism. This fixes bug bugref:[52] by improving the error message when an overloaded operator is inconsistent with its context. 23 files updated, including major changes in overload.sml, types.sml, unify.sml, elabcore.sml, typesutil.sml. The overload declaration is still used in pervasives.sml, where the order of the specified instances of an ordering determines the default interpretation (i.e., the first one).

The SCHEME and LITERAL forms of tyvars are replaced by a new OVLD form that tracks potential instantiations of the type of the overloaded vars or literals.

owner:[David MacQueen,http://cs.uchicago.edu/~dbm]

Moved base/NOTES/HISTORY file to doc/src/changelog/HISTORY.txt and converted it to ASCIIDOC format. Have also moved the README files from base/READMES to doc/src/release-notes. These changes are part of a general effort to rationalize and improve the documentation of the SML/NJ system.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Preliminary cleanups before changes to overloading

Minor cleanup in Elaborator/elaborate/elabcore (function elabOVERLOADdec) and in ElabData/types/typesutil.sml (function matchScheme). Preparing for a new method of handling type checking of overloaded operators. [Note that there is no reason for the options field of OVLDvar to be a reference — it is never updated. Changing this requires corresponding change in pickling.]

Also added an etopdebugging flag (ElabControl) for debugging in elabtop.sml. Modified elabcontrol.{sml,sig} and elabtop.sml. Also rearranged ast and absyn printing in evalloop.sml.

owner:[David MacQueen,http://cs.uchicago.edu/~dbm]

Improved error messages in ml-ulex for unclosed strings. Also made documentation improvements.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added -D_FILE_OFFSET_BITS=64 flag to x86-linux makefile. This flag is necessary to avoid spurious EOVERFLOW errors on some versions of Linux. The problem appears to be limited to large file systems that have more than 2³² inodes.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added %value directive to ml-antlr; this addition improves the error repair choices by allowing non-nullary tokens to be inserted when making repairs.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Created new doc tree in SML/NJ repository. Currently this tree just holds the sources for UNIX-style manual pages for the command-line tools (fixing bug bugref:[35]). The documentation is written using the ASCIIDOC format. Use the following svn command to checkout a copy of the documentation tree:

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Compiling the runtime system on cygwin was failing because the file exceptions.h was missing. It appears to have been part of previous versions, so a version has been incorporated verbatim in the file runtime/mach-base/cygwin-fault.c file (fixes bug bugref:[125]).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added the actionToString' and repairToString' functions to the AntlrRepair structure. These functions allow one to specialize the printing of tokens based on whether they are being added or deleted.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added patches to support OpenBSD on PowerPC. The patches were contributed by Jasper Lievisse Adriaanse (fixes bug bugref:[124]).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Use mkstemp to implement OS.FileSys.tmpName() on systems that support it (should be all modern versions of Unix). This change fixes bug bugref:[128]. (Thanks to Johannes 5 Joemann).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed a bug in IntInf.~>>, which did not handle negative arguments correctly (bug bugref:[110]).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed a problem in the CPS contraction phase. An optimization that eliminates construction of a record that already exists was not checking that the existing record was the same record kind (bug bugref:[119]).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Switch to using MAP_ANONYMOUS to allocate memory on Linux systems. This change avoids problems when "/dev" does not support execute permission (as seems to be the case with some versions of Linux running on ChromeBooks; bug bugref:[120]).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fix for bug bugref:[127] (Crash on Windows with OS.Process.system).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed a long-standing bug in Socket.recvVec, which prevented the result from being used in a string pattern match (thanks to Vesa Norrman for the fix).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed minor issue in an error message; type variable name should be printed with leading '.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added PackWord{16,32}{Big,Little} structures to the Unsafe module. This change makes the UNSAFE signature closer to the MLton version, although we still need to add the PackReal structures.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fix bug bugref:[115] (BinPrimIO writer method getPos does not work under CML). Just needed to port the position update from mkReader code to the mkWriter code.

owner:[Lars Bergstrom]

Fix bug bugref:[111] (Socket.acceptNB returns somewhat broken sockets). The problem was that under Win32, sockets returned from accept inherit their parents' non-blocking status, whereas on UNIX they are always blocking.

owner:[Lars Bergstrom]

Fix bug bugref:[117] (BinIO.openAppend raises IO on non-existent file). We were opening the file for append if it existed but not creating it if it did not exist.

owner:[Lars Bergstrom]

Fix bug bugref:[116] (Socket.sameDesc raises Match exception). The problem is that on Windows the iodesc datatype (defined in Basis/Implementation/Win32/pre-os.sml) has both an IODesc constructor and a SockDesc constructor. Updated the code in Win32/os-io.sml to handle the SockDesc constructor.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fix bug bugref:[113] (Socket.select waits exactly twice the indicated timeout)

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fix AMD64 code generator to properly sign-extend arguments to IDIVQ.

owner:[Lars Bergstrom]

Fix bug bugref:[108] (off-by-one error in Util/dynamic-array.sml; iterators crash)

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fix bug bugref:[107] (Bogus Int64 comparison operators)

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed bug bugref:[92]. IntInf.scan now handles the "0x" prefix correctly. Also made minor improvements to the NumScan module.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added Base64 module to SML/NJ Library to support encoding and decoding Word8 vectors as base64 strings.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Additions to the SML/NJ Library. Added exists, existsi, all, and alli functions to ORD_MAP signature and implementations, and added all function to ORD_SET signature and implementations.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Bug fix in ml-antlr to ensure that the generated toString function for tokens is strictly legal SML code (i.e., non-printing characters and UTF8 multibyte sequences are properly escaped).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added getu function to ULexBuffer as a way to improve ml-ulex performance. This addition allows a fastpath for processing ASCII characters, which improved lexer performance by 3-4%.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed bugs bugref:[89] and bugref:[96]: Build Failure with Xcode 4.3 Also removed build support for MacOS X pre-10.5 (Leopard) on PPC and pre-10.6 (Snow Leopard) on Intel.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed bug bugref:[88]. The check for valid arcs on Unix systems now allows any character other than slash or nul.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed implementation of Real.signBit on little-endian machines.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

1) Fix for bug bugref:[60] recalculate strictness for DEFtycs in functor bodies when functor is applied (Elaborator/modules/evalent.sml)

2) Fix for bug bugref:[77] separate ast representations for datatypes and datatype replications in decs and specs (multiple files)

3) set version to 110.74

Details in NOTES/changes/dbm_2012_1.

owner:[David MacQueen]

Bug fixes for Unsafe.blastRead (bug bugref:[76]): . proper error handling when reading from memory and there are not enough bytes. . pass correct data pointer and length to BlastIn (code was using old macros).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added hash-table-based implementation of sets to SML/NJ Library.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Better error reporting under 32-bit linux for the missing dpkg support (bug bugref:[70]). Enable 3.x kernels to build (bugs bugref:[80], bugref:[81], bugref:[83]).

owner:[Lars Bergstrom]

Added new S-expression library to SML/NJ Library (contributed by Damon Wang)

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed bug in JSON scanner (SML/NJ Library). It didn’t handle escaped backslash or double quote correctly.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added boolean literals (true and false) to the conditional-expression syntax in CM. Thus, you can write

in a CM file. This change is meant to make it easier to use autoconf to configure the build process of an SML application.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added missing String.scan function (bug bugref:[69]). This also fixes the handling of certain corner cases by String.fromString.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added the RTDSC and RTDSCP instructions to the amd64 code generator.

owner:[Mike Rainey,http://www.mpi-sws.org/~mrainey]

Added fix for comments in code bug (bug bugref:[63]). Thanks to Michael Norrish.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed bug in Socket.acceptNB (bug bugref:[59])

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed syntax error in ml-lex compatibility mode (bug bugref:[49])

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Update _arch-n-opsys script for Mac OS X Lion (10.7).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added Barriers module to CML.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed ml-yacc examples to respect the changed signatures with respect to TextIO.inputLine.

owner:[Lars Bergstrom]

Changed the Win32 implementation of validArc to support directories with extended characters (umlauts, etc.).

owner:[Lars Bergstrom]

Fixed the Win32 socket and polling implementation to work correctly with CML. Signature of poll was wrong and didn’t handle sockets at all.

owner:[Lars Bergstrom]

Fixed Real.toString and Real.fmt to include sign for negative zero.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed the bug with Win32 calls to OS.Process.system not quoting the string.

owner:[Lars Bergstrom]

Applied patch for building on more recent versions of NetBSD (bug bugref:[39]).

owner:[Jon Riehl,http://jonriehl.com/]

Fixed performance bugs in List module by making @ and foldr be tail recursive (bug bugref:[51]).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed the Win32 unable to print long strings bug (bug bugref:[37]).

owner:[Lars Bergstrom]

Fixed an overrun during major GC. If the string arena was nearly full, it was possible for alignment padding added during copy to the to-space to overrun the allocated size.

owner:[Lars Bergstrom]

The ml-antlr and ml-ulex programs have been ported to build under mlton.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added %header directive to the ml-ulex scanner generator. Also updated the documentation.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added @SMLsuffix flag to sml command. This flag can be used to get the suffix for heap files.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added --strict-sml flag to ml-ulex for MLton compatibility.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added %header directive to the ml-antlr parser generator. Also updated the documentation.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Changes to support compiling the runtime system on Mac OS X 10.6 (aka Snow Leopard).

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed a bug in the register-spill generator that is part of the MLRISC register allocator. The problem was that the code in RASpillWithRenaming functor assumed incorrectly that dedicated registers would appear in def/use information generated by ClusterRA. Thanks to Allen Leung for helping with this bug.

owner:[Mike Rainey,http://cs.uchicago.edu/~mrainey]

Removed redundant implementations of various top-level operations by consolidating them in base/system/smlnj/init/pervasive.sml. This change also fixes a bug in that the top-level version of round was incorrect.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed bug in Int32.fmt when the argument was the minimum int and the radix was something other than DEC.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Fixed bugs in how ml-antlr parsed ML types in %tokens specifications.

owner:[Aaron Turon]

Picking up some additional fixes for 110.69, including a fix for spaces in CM file paths.

owner:[Jon Riehl,http://www.jonriehl.com/]

Re-enabled some CPS optimizations (first_contract and eta). The most important effect of this change is to make uses of SMLofNJ.Cont.capture be properly tail recursive.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

New concurrency-related instructions for x86 and amd64 code generators.

Added makefile and other support for building runtime on OpenBSD.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Minor fix to ml-ulex backend for regexps that match any character and perform a single action. Previously the emitted code would not allow the regexps to match any character at all.

owner:[Aaron Turon]

Added build support for OpenBSD (thanks to Brian O’Hanlon).

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed Int64.fromString to use base-10.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Various updates to the ml-lpt tree. The documentation has been updated; bugs in the parsing of negation and character classes in ml-ulex have been fixed; and changes have been made to make the ml-lpt tools more compatible with MLton (and other SML implementations). Thanks to Matthew Fluet and Aaron Turon for their patches.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Implemented timer-based profiling on Windows, with behavior as close to the *nix ITIMER-based profiling as possible.

owner:[Lars Bergstrom]

Finished off the Windows subset of the basis library. Added process support and various configuration and system identification utils.

owner:[Lars Bergstrom]

Major changes to the RegExp library: see smlnj-lib/CHANGES for details.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Added the Windows Status structure

owner:[Lars Bergstrom]

Added the Windows DDE structure

owner:[Lars Bergstrom]

Added the Windows Config structure

owner:[Lars Bergstrom]

Added outline of the Windows basis library and the basic registry functionality.

owner:[Lars Bergstrom]

Fixed the amd64 code generator to compile with the current MLRISC.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

nlffi was updated to work on Windows. It needed to pass in the correct value for the name of the kernel32 DLL to obtain base bindings. Additionally updated the README for the most basic nlffi sample with what you need to do on MacOSX and on Windows to make it work.

owner:[Lars Bergstrom]

Overwrite the SMLNJ_HOME environment variable on installation Properly change the package code so that subsequent version installations prompt for uninstall (instead of repair/remove)

owner:[Lars Bergstrom]

Cleaned up WININSTALL file for new MSI-based setup.

owner:[Lars Bergstrom]

Ensure that the size of the allocation space is at least 128K.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed type error in ml-lpt library that occurs when compiling against a basis that was compiled with the USE_64_BIT_POSITIONS symbol set. (Thanks to Johannes Joemann)

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed the amd64 code generator to compile with the current MLRISC.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Made sml.bat more resilient to either not having run the installer and having no SMLNJ_HOME set or having just shuffled the directory around.

owner:[Lars Bergstrom]

A collection of bug fixes for machine.sml in the Reactive library. (Thanks to Timothy Bourke)

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Patches for Mac OS X 10.5 (Leopard).

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed some bugs in the AMD64 floating-point spilling code.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Added support for the atomic XCHG instruction.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Added AMD64 support for floating-point negation.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Fixed ^C handling in Windows Added a Windows installer Made it possible to build for Windows on a mapped drive from Parallels

owner:[Lars Bergstrom]

Added AMD64 support for the atomic fetch and add instruction.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

The GAS output now favors p2align over align, since the former is guaranteed to be consistent over multiple architectures and the latter is not.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Fixed a bug in register spilling.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Added demo support for AMD64 for quick testing and fixed support for 64-bit label constants.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Added support for the MLRISC COND instruction and the x86-64 CMOVCC instruction.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Fixed an instruction-selection bug when loading 64-bit labels.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Fixed Elaborator and Translate performance bugs

owner:[George Kuan,http://www.cs.uchicago.edu/~gkuan]

Fixed xorl memory argument bug.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Added f64sgn (for Real64.signBit) as a primop defined in MLRiscGen. signBit(~0.0) not handled correctly.

owner:[George Kuan,http://www.cs.uchicago.edu/~gkuan]

Fixed bug in {TextIO,BinIO}.StreamIO.endOfStream that would incorrectly signal end of stream.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Eliminated config/allsources. The information is now drawn directly from config/actions.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

owner:[Matthias Blume,http://www.tti-c.org/blume/]

After Aaron Turon’s bug fix for ml-ulex (handling the ^ character in legacy mode), re-ran the lexer generator on all lex input files and committed the results.

This should fix the problem with ckit and nlffi that was reported by Vesa A. Norrman.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

3rd merge of base from primop-branch-3 into the trunk. Additional bug fixes included:

Fixed some bugs in new Div code in FLINT/trans/translate.sml.

Also, changed the handling of "no core access": When translate.sml needs access to a core exception at a time when the core has not been set up yet (this only happens when compiling system/smlnj/init/*), then don’t bother generating the corresponding tests.

The old scheme was to generate a bogus value to be used in place of the exception. Unfortunately, that confuses the plambda type checker. Moreover, it does not do any good, because at runtime we don’t expect such an exception to be ever raised. (The code in system/smlnj/init/* has to be written very carefully with this in mind!)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added FSQRT instructions for the AMD64 code generator.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

FLINT/trans/translate.sml now wraps all DIV/MOD/QUOT/REM operations with an explicit test for zero division. This should fixe several regressions and makes it possible for downstream optimization phases to treat these operations as "pure" when they are applied to unsigned operands.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added the new MLRISC code generator for the AMD64. This version, in contrast to the previous one, uses SSE registers and instructions for all floating-point computations.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

A number of fixes related to the formatting of dates. These include fixes for bugs #1415 and #1416. We also now correctly handle format characters that lie outside the specified set.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

CMB (and CM) now automatically defines the CM "preprocessor" symbol NO_PLUGINS during "makeml -rebuild" or when CM operates in "slave" mode.

I changed the three locations within the sources that get compiled during CMB.make where ml-yacc or ml-lex input is processed: When NO_PLUGINS defined, then the use of the mlyacc and mllex tools is bypassed.

When bootstrapping new versions of the compiler, there can be situations where the plugin tools for ml-yacc and ml-lex (or ml-ulex) are not available or otherwise not operational. In this case one can manually define the NO_PLUGINS symbol prior to running CMB.make(). To do so, the following command should be issued at the interactive prompt:

A CMB.make with NO_PLUGINS defined relies on the existence of the files that normally would be generated by ml-yacc and ml-lex. (Copies of these files are in the repository.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Second merge of base from primop-branch-3 into the trunk. Additional bug fixes included:

Changed the installation mechanism for CM tool plugins. These are just libaries and now get installed like ordinary libaries.

There are now a number of new installation targets that give some fine-grain control over what classes and suffixes are known, and what they will map to. See config/targets for details.

The code that caused plugin installation as part of running a tool’s "build" script has been removed. (The build script is for building, not for installing.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added a boolean control named cm.tolerate-tool-failures (env. variable name: CM_TOLERATE_TOOL_FAILURES). The default is false and makes CM fail if a shell tool reports a non-success exit status. If the control is set to true, then CM will press on after tool failures in the event that the target files exist (even though they are considered outdated). Turning the control to true can be useful for bootstrapping.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Merge of ml-lpt revisions for 110.64.

The name of several ml-lpt-lib modules has changed:

The ml-antlr specification format has changed: declarations such as %tokens and nonterminal definitions can occur multiple times in the same specification. The semantics are such that each new declaration extends the previous ones. This does not apply to %start or %name, of course.

Importing a grammar via %import now includes all declarations in from the imported grammar, except for %name, %entry, and %start. Tokens and nonterminals can be dropped using the new %dropping clause of the %import directive; the separate %drop and %extend have been removed.

We now allow optional type annotations on nonterminals, using the %nonterms directive as in ml-yacc.

The refcell construct is now implemented using SML’s regular reference cells, so the :== and !! notation has been deprecated.

The ml-antlr tool now does much more checking of specifications, and its error messages have been greatly improved. Error repair for generated parsers has been completely rewritten, and is now both much faster and more accurate.

ml-ulex is now more lenient with escape codes (non-SML-standard escape codes are now interpreted literally, so e.g., \| denotes "|"). Also, character classes may now include a "-" character at the beginning as is standard in most other regexp tools.

All of these changes are documented in the user guide, which has been updated and improved with this merge.

owner:[Aaron Turon,http://www.cs.uchicago.edu/~adrassi]

Merge of the primop3 branch (base) into the trunk to create 110.63.1. Significant changes in FLINT and the front end, mostly having to do with a reorganized system for handling primops. Various bug fixes and improvements in printing signatures.

owner:[David MacQueen,http://www.cs.uchicago.edu/~jhr]

Preliminary commit of large ml-lpt revisions (more to come for 110.64). The ml-antlr specification format has changed: declarations such as %tokens and nonterminal definitions can occur multiple times in the same specification. The semantics are such that each new declaration extends the previous ones. Grammar extension constructs have also changed. We now allow type annotations on nonterminals. Finally, the refcell construct is now implemented using SML’s regular reference cells, so the :== and !! notation has been deprecated. All of these changes will appear in the 110.64 user guide for ml-lpt.

The ml-antlr tool now does much more checking of specifications, and its error messages have been greatly improved. There has also been some work on the error repair process for generated parsers, but this will be further improved in 110.64.

owner:[Aaron Turon,http://www.cs.uchicago.edu/~adrassi]

More Basis fixes: The Char.fromString (etc.) functions did not handle the "\uxxxx" escape sequence. There is still an outstanding bug with String.fromString the tail is a format escape. I added a comment to this effect in Basis/Implementation/string.sml. Thanks to Andreas Rossberg.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Added next function to Fifo and Queue modules in the SML/NJ Library.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

More Basis fixes: Time.fmt dropped the leading "~" for negative time values that had no whole part.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

More Basis fixes: the OS.Path module did not include the InvalidArc exception and did not do sufficient argument checking. Thanks to Stephen Weeks and Adam Chilpala.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed an unbound functor bug in the AMD64 CM file.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Substantially changed the signature and implementation of AMD64 SVID. It now looks similar to the ia32 SVID, yet uses staged allocation.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

More Basis fixes: the WORD signature was missing {to,from}Large. Thanks to Andreas Rossberg.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed bogus operand sizes in AMD64 instruction spilling.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Fixed a number of inconsistencies between the Posix.TTY structure and the Basis specification. Thanks to Adam Chilpala.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Added preliminary support in MLRISC for Staged Allocation, a technique for specifying calling conventions (see http://www.eecs.harvard.edu/~nr/pubs/staged-abstract.html). Initially, we plan to use this code to generate C calls for the AMD64.

The staged allocation code base resides in MLRISC/staged-allocation, and specialized calling conventions go in MLRISC/ARCH/staged-allocation.

owner:[Mike Rainey,http://www.cs.uchicago.edu/~mrainey]

Bug fix: when SaveCState was called with two values to save, a subsequent GC could cause the RestoreCState to fail because the saved state had been promoted to tagless pair.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed bug triggered by:

The x86MCEmitter crashed when the immediate operand to MOVB was outside of the range -128 … 127. I’ve changed the code so that the range check is disabled. Only the low order 8 bits of the immediate operand are now significant.

owner:[Allen Leung]

Eliminated any mention of lexgen, which was an early precursor to ml-ulex.

You should update your admin directory, so the shell scripts for maintaining your local copy of the repository reflect this change.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed bug in CM’s parallel make facility that failed to have the master re-link modules after letting slaves compile them.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed typo in ml-build script that prevented library anchors from being registered.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Brought ml-lpt manual up-to-date with the code. Many minor improvements to the tools, and a few minor bugfixes. Prepared ml-lpt-lib for integration with new UTF8 structure. Changed the interface for creating streams in ml-ulex (we now support stream creation from several kinds of sources). Overall, the tools are now quite stable, and their interfaces are unlikely to change in a way that would break compatibility. More work, however, is needed in the documentation.

owner:[Aaron Turon,http://www.cs.uchicago.edu/~adrassi]

Implemented library installer. Moved CM plugin code for ml-burg, ml-lex, and ml-yacc out of CM source tree and into their respective trees. Implemented CM plugin for ml-ulex and ml-antlr. Used library installer for ml-burg, ml-ulex, and ml-antlr.

For ml-yacc and ml-lex we continue to have permanently "plugged-in" CM tools. (It turns out to be too messy to do otherwise because there is too much code that during installation relies on the presence of these tools — resulting in a tricky ordering problem.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added SMLofNJ.shiftArgs which is like a shell’s "shift" command. Modified CM’s startup code to use shiftArgs as it processes command line arguments. This way, the init code in each .sml-file or library that is mentioned at the top level will see only those arguments that have not yet been processed at this point. In other words, the init code can "seize control" and process the remaining command line.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added fromList function to the ORD_SET interface and lookup to the ORD_MAP interface. See the SML/NJ Library CHANGES file for details.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Added the UTF8 structure and signature from the Moby compiler to the SML/NJ library (and the CML library). These modules will replace the version in the ml-lpt-lib.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Added entries to handle ml-lpt-lib.cm in installer.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed brown-paper-bag bug with CM’s pathname handling, which made installation fail under Win32.

This supersedes the pre-brown-paper-bug release (see below).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed the code in runtime/c-libs/posix-tty/{tcgetattr,tcsetattr}.c to get the c_cc termios data copied correctly. Also moved the allocation of the string to avoid problems if it caused a GC.

Thanks to Timothy Bourke for the bug report and fix.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

Added code to CM’s "standard shell tool" implementation which causes it to tolerate (with a warning) the situation where the shell command fails (e.g., due to the shell command’s non-existence) as long as all target files exist.

This makes it possible to, e.g., build ml-yacc from sources even if svn checkout messed up the time stamps on files in such a way that yacc.grm is younger than yacc.grm.sml or yacc.grm.sig. (Ml-yacc would be needed to re-process yacc.grm, but obviously it might not yet be available at that time.)

owner:[Matthias Blume,http://www.tti-c.org/blume]

Fixed the types of recvVecFrom, recvVecFrom', recvVecFromNB, and recvVecFromNB' in the SOCKET signature. This error is actually in the SML Basis specification too.

owner:[John Reppy,http://cs.uchicago.edu/~jhr]

CM now reports undefined anchors as errors and aborts execution rather than silently pressing on using bogus values.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Use Say.vsay for printing the "[autoloading]" message, so #set CM.Control.verbose false (or -Ccm.verbose=false) can be used to suppress them.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed bug in CM where "with:" specifications that affect compilation (as opposed to parsing) were ignored.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

This is the first subversion-hosted release. There are also changes to the directory layout. Here is a table:

(All pathnames are relative to the SML/NJ "root" directory.)

In addition, there is also a new

directory containing two new program generator tools: ml-ulex and ml-antlr (a lexer generator that handles unicode and an ANTRL-inspired LL(k) parser generator). These tools are currently "beta-quality"

The latest versios of the sources can now be obtained anonymously via subversion. For this, it is useful to first check out

and put the resulting directory on your shell’s PATH. This provides access to three shell scripts: checkout-all.sh, stat-all.sh, and refresh-all.sh.

To create a freshly checked-out copy of the sources, do

where dir is the optional SML/NJ root directory (default is ".").

This creates the above directory layout. Each subdirectory of the root is under individual subversion control. The stat-all.sh and refresh-al.sh scripts apply "svn stat" or "svn update" to each of these subtrees.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Reorganized directory layout.

This is a temporary solution, more reorganization is to come.

The basic idea is to have a number of toplevel trees, each corresponding to a well-defined part of the overall system. Each part can be maintained individually, even in separate source repositories, although currently we still serve everything out of the main smlnj-gforge tree.

Installer and and scripts have been updated to reflect the new layout. The installer (base/src/system/smlnj/installer) is now "scriptable" to avoid burning too much knowledge about the layout into SML source code. The main script used by the installer is in config/actions.

The main change is that many of the subdirectories of what used to be known as "src" have moved to the toplevel. The "src" directory itself has moved down into a subtree called "base". (We may eventually get rid of the extra level of indirection represented by "src".)

The layout is now as follows:

In $gf/admin there are a few useful shell scripts for checking out and maintaining the entire collection of trees:

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Merged code for AMD64 backend (Mike Rainey’s work). Everything is hooked up but untested.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

I am freezing 110.59. Changes other than the version-number increase:

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Implemented ml-makedepend (i.e., CM.sources) in a better (more robust) way. This should hopefully fix the ml-makedepend problem permanently.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed long-standing bug with ml-makedepend where it would output a spurious dependency to a non-existing file. (This is a simple fix. It might need further looking into.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Committed patches received from Johannes 5 Joemann (joemann@befree.free.de) that enable heap2exec under Linux and FreeBSD.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

MLRISC changes:

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Incorporated several bugfixes to lexgen. Compiler now compiles to fixpoint when using lexgen instead of ml-lex.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Removed ml-flex and added lexgen instead, using Aaron Turon’s newly provided tarball. The generated lexers still have problems.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Removed ml-flex's dependency on regexp-lib.cm. Turned installation of ml-flex on by default.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added ml-flex sources. Partially integrated, but should not be turned on yet! (Read: leave it commented-out in config/targets!)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Changes to support building on x86-64 systems (using the 32-bit mode). Also cleaned up signal handling on Linux. Support for pre-2.2 Linux kernels dropped.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

CM has changed. Updated the script for rebuilding the MLRISC generated files.

owner:[Allen Leung]

Hooked code for Darwin-specific Intel ABI into main compiler. (This is a temporary solution which relies on the fact that the compiler itself does not use NLFFI. Eventually we need to divorce intel mac from generic x86 unix code and make separate sets of binaries.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Changed MLRISC x86 CCalls for partial support of Mac OS X ABI.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Changes to support Mac OS X on Intel hardware. The C-calls support in MLRISC must also be updated to support the Mac OS X ABI.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Improved error reporting and handling in CM.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Enabling $/html-lib.cm in config/preloads did not work. This is fixed now. (Since the anchor mapping for html-lib.cm is not yet in effect at the time when config/preloads is processed, the library has to be referred to by another name. In 110.57 this would be $SMLNJ-LIB/HTML/html-lib.cm. I arranged for $smlnj/smlnj-lib/html-lib.cm to be valid as well.)

Thanks to Todd Wilson (Fresno) for alerting me to this issue.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed a problem in config/install.sh where it tries to "fish" the name of the CM metadata directory from the wrong place (because the physical location of basis.cm has changed). Also, corrected the path anchor for $/html-lib.cm. (Thanks to M. Fluet for pointing out these problems.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed problem with bogus exception message when using back-trace facility.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added simple implementation of Array2.copy. (Warning: mostly untested.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Reversed change to src/system/smlnj/internals/versiontool.cm. This file gets loaded as a tool — by the equivalent of CM.make during the run of CMB.make. Thus, CMB’s path configuration is meaningless for it. Instead, it has the status of "user code", so it should use $/basis.cm to refer to the Basis library. (At least that’s true for the purpose of bootstrapping the previous change. In the future it might make sense to have versiontool.cm refer to $smlnj/basis/basis.cm, i.e., the version of the Basis that the compiler itself uses.)

Also patched src/system/testml to have it activate those extra anchor bindings in config/extrapathconfig.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

This change affects the way the following libraries are tied into the system:

These libraries are now internally (as seen from the source code of the implementation itself) known by the following names:

This makes it possible to work with code that requires different versions of these libraries, and which refers to these libraries using their "default" names (i.e., the first set of names above). In other words, one can un-define or re-define those default names without compromising the proper functioning of the compiler itself.

A similar procedure had already been performed for several of the MLRISC libraries that are linked into the compiler. I did some cleanup on this code.

A new file in the config directory (named extrapathconfig) is responsible for setting up path anchors that the compiler itself does not need, but that are typically required by user code.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed erroneous out-of-bounds test in the "update" function of various *ArraySlice modules. (Thanks to Vesa A. Norrman for pointing out the problem.)

Pushed some Basis changes through ML-Lex, CML, and eXene.

owner:[Matthias Blume]

Fixed a Basis incompatibility: The depreciated function Substring.all was removed (use Substring.full instead).

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Tweaked interval set API in SML/NJ library; see the CHANGES file for details.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed a Basis incompatibility: Pack<N>{Big,Little} structures should be named PackWord<N>{Big,Little}.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed a minor Basis incompatibility: hex digits should be upper case.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Added interval sets to utility library (signatures INTERVAL_DOMAIN and INTERVAL_SET, and functor IntervalSetFn).

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Add Zhong Shao’s fix for datatype equality functions.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Bug fix a bug found by Carl Hauser. There was a typo in the reload code for FCMP in x86SpillInstr.sml.

owner:[Allen Leung]

Removed some debugging code in file x86Asm.sml. The function emit_operand was printing out debugging output.

owner:[Allen Leung]

Fixed ml-lex to recognize "\r" as representing carriage return.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed ml-yacc to work on files with non-native end-of-line encodings (e.g., Windows text file on a Unix system).

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Added changes from Dominic Evans (oldmanuk (at) gmail (dot) com) to support HPUX 11.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Changes to the SML/NJ Library. See smlnj-lib/CHANGES for details.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Fixed reversed logic for deciding whether to "copy up" or "copy down" in *-array-slice.sml.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

A typo in the Cygwin code fixed.

owner:[Allen Leung]

Updated Cygwin’s fault/signal handling to match the Windows version. Updated the export list.

owner:[Allen Leung]

Added support scripts for Mac OS X PackageMaker and modified config/install.sh so that it supports re-dumping a heap image after customization.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Un-overloaded / to work around bug in overloading resolution code.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added mechanism for re-creating a heap file for the interactive system after configuration variables have been changed.

This is much like SMLofNJ.exportML, but starting from the resulting heap does not return to the caller of CM.redump_heap but restarts the interactive system from scratch. The original call of CM.redump_heap does not return but ends the interactive session. Thus, CM.redump_heap is a lot like SMLofNJ.exportFn.

Internally, redump_heap winds the dynamic execution context back to the point where the original heap image was created and re-executes the heap image generation code in the boot code.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added a hack to the existing hack known as Word64 to make fromString behave correctly. I am still not sure whether Word64.scan will work as specified with respect to the interaction of radix and prefix.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added a gc protocol checking phase. This phase is enabled with the flag "check-gc". "debug-check-gc" turns on the verbose mode.

owner:[Allen Leung]

Fixed a bug in the implementation of div and mod for IntInf. Thanks to Neophytos Michael for reporting the problem.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added the join combinator to the ParserComb module in the SML/NJ Library.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed serious bug (brown paper bag variety) in new implementation of structure Atom in CML. (I had accidentally used a mailbox instead of an mvar, leaving the door open for races.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Brought back SMLofNJ.Susp. The underlying suspension type is the one implemented in Core, which means that it is the same as the one used by the lazy extension.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Simpler and at the same time more general implementation of structure Atom in CML.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Created new "tools" directory under "src" and moved "TraceDebugProf" there.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Implemented "long long" arguments and results for NLFFI. (Only the PPC/MacOS implementation is complete, the other backends still need to be updated.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Minor cleanup in ML-Yacc rule printing mechanism. This should fix a problem with certain "as" patterns which previously got rendered using incorrect syntax.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made time profiling code (interrupt handler) in runtime system aware of new array representation.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Implemented new (but still experimental) heap2exec facility. This is tested under Mac OS X and should work under Linux (will test shortly). It will probably also work on the Sparc (will test some time later). Also removed old "HACKED_STANDALONE" hack from runtime

To be able to test heap2exec, uncomment the request for "heap2asm" in config/targets prior to installation. (Notice that this is different from "heap2exec" mentioned below. Not a typo.)

To perform an actual test, run the command

(You can put heap2exec on your shell’s path.)

For example, run

This will create a standalone executable called "mly" that you can then invoke directly as a command.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

fixed off-by-one error in ML_STRING macro (globals.c)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made ml-build script "smarter" (but only very little).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Some cleanup in the $c/memory.cm library: separated some concerns by moving allocation code and memory access code each into their own files.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

The Unix I/O library of SML/NJ on Cygwin does not understand Windows style pathname, so problems arise when SMLNJ_HOME is set to a Windows style pathname. The _run-sml script now converts SMLNJ_HOME to a POSIX pathname on Cygwin.

owner:[Allen Leung]

Last-minute changes incorporated into 110.52. Release tag moved.

The changes: - HashString.hashString' → HashString.hashSubstring - bug fix in UnivariateStats

owner:[Matthias Blume,http://www.tti-c.org/blume/]

More on the space problem (this time for Win32).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Hacked some of the scripts (in particular: the installer) to cope with spaces in filenames a bit better. But beware: the current "solution" is likely still full of bugs and inherently incomplete. (We need to do away with those shell scripts for a comprehensive solution.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed bug in code for ml-makedepend.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added two simple but potentially useful statistics modules to SML/NJ Library. (See CHANGES file there.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Updates to SML/NJ Library

(Also see CHANGES file for smlnj-lib.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made sure CML compiles when the Position structure is Int64.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

The compiler can now be compiled in a mode that makes structure Position equal to Int64. The default, however, is unchanged (Position is Int31) for the time being.

To enable 64-bit positions, use the following procedure:

This is barely tested. The only test so far was a little SML program counting the number of characters in an 8-gigabyte file by reading it character-by-character. That test was successful.

In support of 64-bit positions, a number of new functions have been added to the runtime system.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed a problem with unhelpful error messages related to problems with .cm or .sml files that appear as part of the sml command line.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Enabled dlopen and friends for FreeBSD (as recommended by Johannes 5 Joemann).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added support for MLTree constructs LIVE and KILL to all the architectures.

owner:[Allen Leung]

Structure Int64 fully hooked in. (The implementation is not very efficient, though.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

All the pieces of Word64 are now there, with the exception of the conversions from and to LargeWord. (Eventually these need to be identities, but for the time being they don’t even make sense because LargeWord is 32-bit wide.)

Also started to add similar support for Int64, but major pieces of that are still missing.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Structure Word64 is now (almost) complete, word literals and patterns seem to work. There are a few odd pieces missing. In particular, I didn’t do the {from,to}LargeWord parts because LargeWord is still Word32 at the moment.

Making Word64 official would mean that LargeWord becomes Word64. But this requires extreme care because most word-word conversions have to go through LargeWord, so making a mistake means loss of efficiency or worse. Eventually there will be a solution similar to (but actually simpler than) what I did with IntInf.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

More 64-bit hacking (but still not even half-way there yet). Also, some assorted improvements to the handling of 8-bit words.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Started adding some infrastructure for supporting 64-bit int- and word-types. (Still in its very early stages.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

BackTrace.monitor now also reports the source of the exception that triggered the trace.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

This is the HISTORY entry for two earlier commits, both concerning the x86 c-calls code in MLRISC:

John discovered a bug in the syntax of fucomip. The opcodes FU?COMIP? have been changed to

owner:[Allen Leung]

Added a mechanism for getting back-trace information from standalone programs. Here is how it works:

I changed the library name $/trace-debug-profile.cm to $smlnj-tdp/plugins.cm, and added the following new libraries:

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added an "obsolete" warning for the "group owner" syntax to CM's parser.

Eliminated group owner specs from .cm files throughout the source tree.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

To get the benefits of any of these plugin modules, the code in question must be compiled with TDP instrumentation turned on. This can be done by setting SMLofNJ.Internals.TDP.mode to true. (The ref cell is also controlled via the -Ctdp.instrument=… switch.)

Plugins are selected at link time. (Pre-compiled instrumented code can be re-loaded with different plugins in effect.) When an instrumented module is linked, whatever plugins are at that time enabled will come into effect for that module.

To enable the back-trace plugin, load library $/trace-debug-profile.cm and invoke BackTrace.install() (e.g., from the interactive prompt). To enable the coverage plugin, load the same library and invoke Coverage.install().

Back-traces are generated automatically on uncaught exceptions and when the code in question explicitly invokes BackTrace.trigger().

Coverage (and execution frequency-) information must be queried explicitly by calling Coverage.not_covered and Coverage.hot_spots.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Snapshot of a significant overhaul of how the trace/debug/profile support is hooked into the system (specifically: Core and SMLofNJ.Internals).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Some rationalization of names:

This is is preparation of using the original back-trace instrumentation for other purposes. "TDP" stands for Trace/Debug/Profile.

The control flag controlling whether instrumentation is on or off is now registered under a different name, so instead of running sml as

one has to say

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made some minor modifications to elabcore.sml to have source regions be propagated more tightly — resulting in better (i.e., smaller) regions being reported in error- and debug messages.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed handling of keywords in .cm files: After seeing "is" the lexer treats subsequent occurrences of "group", "library", "source", "is", "*", and "-" as ordinary identifiers rather than keywords.

Most seriously, this fixes a problem with CM’s "shell" tool. The tool is supposed to accept a tool argument called "source", but this did not work because of the clash with the keyword.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Assorted cleanup work:

Cleaned up the absyn to reflect the invariant that HANDLE always carries a FNexp as part of the type definition. This eliminates some superfluous sanity checks at runtime down the road.

Some minor cleanup of the btrace code.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added hack to make slave mode work in the presence of the version tool. (Still, since the master does two passes over the code for CMB.make, the release number gets bumped twice when slaves are attached. I don’t know if this is worth fixing…)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Implemented some CM magic to have file src/compiler/TopLevel/main/version.sml generated automagically. The version is taken from two files: config/version and config/release. The first is expected to contain a two-part version number such as 110.49. The second should contain a single number, but it may be missing.

If the environment variable VERSIONTOOL_BUMP_RELEASE is defined at the time the version tool is loaded (which is the first time you say CMB.make), then the tool will increment the value stored in config/release every time CMB.make is invoked.

The binfile format is now insensitive to anything beyond the first two components of a version number, so bumping the release does not render binfiles incompatible. Auto-bumping can be used to keep track of versions during development without invalidating existing binfiles.

In any case, every CMB.make updates the date information in version.sml. (This is the date that is printed in the banner.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Some cleanup of the controls code.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added two pieces of functionality to the Controls interface:

grabs the current value of the control in stage 1 and restores it in stage 2.

stores the given value into the control in stage 2 (i.e., delayed) but does all error checking in stage 1. (This is for string controls that need to do parse their argument — something that might fail. In some cases, notably in CM, one already knows the intended argument but wants to delay the actual assignment until a time when error recovery would be more difficult.)

Also changed the handling of controls in tool arguments to classes "sml" and "lazysml":

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added a new tool class called "lazysml" to CM’s tool chest. The only difference to "sml" is that compilation is done with Control.lazysml set to true. A source of class "lazysml" is automatically recognized by a file name suffix of ".lml".

In addition to the above feature, the original class "sml" now also supports a tool argument "lazy" which has the same effect. As a result, the following three lines are equivalent:

The setting goes into effect both during parsing and during compilation. The original setting is restored right after parsing and after compilation, respectively.

In addition to all the above, there is also a general mechanism to set ANY of the "controls" that are available at the command line via "-C…" on a per-sml-file basis. The same rules that apply for "lazy" apply as well. (In fact, "lazy" is implemented as a special case of the general mechanism.)

The .cm file syntax uses a new keyword tool argument called "with". There are several ways of indicating the desired settings:

Another possible abbreviation is to leave out the =v or value:v part if the name refers to a boolean control (in which case the value is taken to be true). Thus, one could get lazy sml also by saying:

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Turned message about "emiting long form of branch" off by default. Added a control flag to turn it back on when desired.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Applied patch for setting rounding modes under Mac OS X. Thanks to Melissa O’Neill for providing the code!

owner:[Matthias Blume,http://www.tti-c.org/blume/]

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Put target "mlrisc" back into the default list. (There is no harm in having it, and some users have expressed their wish to have "mlrisc" included by default.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed the signal masking code to properly nest mask/unmask operations on a per-signal basis.

owner:[John Reppy,http://www.cs.uchicago.edu/~jhr]

Bumped the heap magic number to 0x09082004 to account for the changed layout of the ML frame under Mac OS X.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added a patch to _arch-n-opsys to enable the Cygwin runtime. The Cygwin runtime is turned on by setting the environment variable SMLNJ_CYGWIN_RUNTIME to 1.

owner:[Allen Leung]

Added some exports to src/compiler/core.cm upon request by J. Joemann.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Upon request by Johannes Joemann:

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added ptreql primop to structure InlineT (upon request from Larry Paulson).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Another bug fix from Carl Hauser:

Without this, any deletion of an edge in an undirected graph does severe violence to the graph.

owner:[Allen Leung]

The IBM/MacOS syntax switch on PPC was incorrectly swapped.

owner:[Allen Leung]

Bug fix from Carl Hauser:

single_source_shortest_paths in dijkstra.sml was observed to get wrong answers (by comparing to single_source_shortest_paths in bellman-ford.sml).

The problem is that following the expression A.update(dist,s,Num.zero) it is necessary to update the priority queue using Q.decreaseWeight(Q,s).

owner:[Allen Leung]

Fiddled with handling of command-line options:

owner:[Matthias Blume,http://www.tti-c.org/blume/]

owner:[Allen Leung]

Added low-level support for choosing C calling conventions by twiddling the type of rawccall. (See src/compiler/Semant/types/cproto.sml for details.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Backed out of change to win32-filesys.c. The earlier patch to get_file_time caused CM to produce files with the wrong time stamp.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added NLFFI support for Win32, adapted from a patch provided by David Hansel. This is currently completely untested. Also, the issue concerning stdcall vs. ccall is still unresolved.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Gearing up towards 110.47…

owner:[Matthias Blume,http://www.tti-c.org/blume/]

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added C_UNION to c-calls/c-types.sml and updated the machinery (ml-nlffigen, cproto.sml) that conveys C function interface information to the code generator.

However, the actual architecture-specific implementation of function arguments and results that are C unions is still not implemented.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added these instructions to the PowerPC architecture: LBZU(X), LHZU(X), LWZU(X), STWU(X), STFDU, STFSU, etc…

Note: I haven’t added their instruction encoding into the description.

owner:[Allen Leung]

Added the two instructions LWARX and STWCX to the PowerPC instruction set.

A (untested) rewrite of loop-structure.sml. The old version is completely broken.

owner:[Allen Leung]

owner:[Matthias Blume,http://www.tti-c.org/blume/]

NLFFI under Mac OS X now working (sort of). This is largely untested, though.

Version bumped to 110.46.1 to account for runtime data format changes.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Changed the implementation of structure Unix so that the same stream is returned every time one of the {text,bin}{In,Out}streamOf functions is invoked on the same proc. This is not what the spec currently says — although IMO it arguably should. (See discussion below.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Changed the interface of structures Timer and Unix to match the most recent Basis spec.

In the case of Unix there still seems to be an open/weird issue:

I took the liberty to implement the following stopgap solution:

PS: I don’t understand the original space leak argument anymore. If a proc hangs on to the imperative stream, then I/O operations on those will advance the state of the cached stream and avoid the space leak.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added signature PACK_REAL and exported functor PrimIO.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

CM now ignores (but still accepts) the "owner" information in group descriptions. The owner of a group is its next enclosing library. Each group must have a unique owner. (There is a virtual "toplevel" library that owns groups which are not nested within a real library.) Previously, each group had to explicitly declare its owner, and CM would check that such a declaration is correct. The new scheme is to have CM check that for each group there is precisely one owning library.

The advantage of the new scheme is that the programmer no longer needs to maintain the somewhat annoying owner information. The downside is that CM cannot enforce the ownership rule across multiple runs of CM.make. Fortunately, enclosing the same group in two different libraries A and B which are not part of the same program does not cause real problems.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made the win32 version work again. (Strangely, a misplaced comma had slipped into win32-process.c which prevented the runtime from being compiled correctly.)

Also, included a minor addition to ml-build.bat analogous to what was done in blume-20040519-ml-build.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Arranged for ml-build to clean up after itself a little bit better. The script generates a temporary SML source file and compiles it using CM, so CM generates metadata (GUID, SKEL, objectfile) for it. It now gets rid of those at the end, so they don’t accumulate under .cm.

This required a minor change to install.sh because the name of the metadata directory (default: .cm) is actually configurable at installation time.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added Posix.IO.mk{Bin,Text}{Reader,Writer} by lifting their respective implementations from internal modules PosixBinPrimIO and PosixTextPrimIO.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added previously missing support for many socket-related functions under win32. Thanks to David Hansel <hansel@reactive-systems.com> for the voluminous patch!

(I have not tested this patch under win32 yet.)

Here is David’s e-mail:

Hi,

Attached to this email you find a diff against sml/nj 110.45 that will enable socket support under Windows.

To apply the patch (using unix or cygwin) 1) gunzip runtime.diff.gz 2) "cd" into "src/runtime" in the source tree of a fresh 110.45 installation. 3) patch -p 1 < [your/path/to]runtime.diff

The code compiles fine but has NOT yet been extensively tested. I only ran a few tests for basic socket client functionality (which worked fine). Especially the functions that use ioctl are not tested at all and might not work (see below).

I implemented this since we want to move to a newer version of sml/nj but need socket support in order to use it. This is the first time I even had a look at the sml/nj source, so please review my changes before making this part of the distribution! Here are a few issues that I think might be better for someone to solve who is more familiar with the sml/nj source (and socket programming):

Fixed two bugs in installml script. (Thanks to Vesa A. Norrman for the patch.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added support for nlffi under netbsd. (Thanks to Vesa A. Norrman for the patch.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

As per request by Adam Chlipala <adam@hcoop.net>, extended various export lists in compiler-related .cm-files.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

The installer now honors the "src-smlnj" target again, although its meaning has changed from "all sources required for the compiler" to "all sources the installer knows about". In other words, if you enable "src-smlnj" in the "targets" file, then the installer will pull in sources for everything. (Notice that this refers to source code only. Compiled code is still only installed for modules that were requested explicitly or which are required for other modules that were requested explicitly.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed IEEEReal.scan (and .fromString) so that if there is an overflow in the exponent calculation we get INF or ZERO (depending on the mantissa and the sign of the exponent).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

The ml-build script now terminates with a non-0 status when something goes wrong.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made exception Option to be the same as exception Option.Option (as it should be).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed the runtime so that ml-nlffi-lib runs on the cygwin version of SML/NJ. The problem is that

does not work on Windows unless we explicitly export symbols such as malloc during linking. We fixed this by explicitly exporting the required symbols with the magic gcc incantation:

where cygwin.def is a file containing all the symbols that we wish to export.

I suspect this is a Windows problem and we’ll have to do the same (somehow with windows compilers) when we build the native win32 version with the system calls LoadLibrary/GetProcAddress.

owner:[Allen Leung]

Fixed problem with IntInf.fmt (sign would show up on the right instead of on the left for BIN, OCT, and HEX).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed problem with installer script (unix only) where bin/ml-yacc and friends pointed (via symlinks) to absolute locations instead of just .run-sml. This was reported by Vesa A Norrman.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Improved handling of exceptions at the interactive toplevel.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Type of top-level "app" corrected. Added code for setting vp_limitPtrMask to Win32-specific runtime.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Eliminated the "dont_move_libraries" directive in config/targets. (The mechanism was broken and could not be fixed easily. Moreover, there does not seem to be any reason not to move all libraries into lib during installation. I originally implemented this directive as a backward-compatibility feature when I first introduced the new CM. Now that things have been stable for a long time and going back to the old CM is not an option, there is no reason to keep it around.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made installer honor INSTALLDIR variable again. (Thanks to Chris Richards for pointing out the problem and providing the solution.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

MLRISC bug fix from Lal.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added missing wrapper for privilege "primitive" in $smlnj/viscomp/core.cm.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

I modified the read-eval-print loop so that the autoloader gets invoked whenever the prettyprinter tries to look up a symbol that is not currently defined in the toplevel environment but which appears in CM’s autoload registry. As a result, we see far fewer of those ?.Foo.Bar.xxx names in the prettyprinter’s output.

In addition to this I tried to clean up some pieces of the Basis implementation (e.g., Socket, Word8Array) in order to prevent other instances of these ?.Foo.Bar.xxx names from being printed.

The mechanism that picks names for types still needs some work, though. (Right now it seems that if there is a type A.t which is defined to be B.u, but B is unavailable at toplevel, then A.t gets printed as "?.B.u" although the perhaps more sensible solution would be to use "A.t" in this case. In other words, the prettyprinter should follow a chain of DEFtycs not farther than there are corresponding toplevel names in the current environment.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Another installer tweak: All the ML code for the installer is now compiled during CMB.make and put into a little library called $smlnj/installer.cm. The installation then simply invokes

and everything happens automagically.

Win32: ML code senses value of environment variable SMLNJ_HOME. Unix: ML code senses values of environment variables ROOT, CONFIGDIR, and BINDIR.

The new scheme guarantees that the ML code responsible for the installation is in sync with the APIs of the main system. Also, the installer is somewhat faster because the installer script is precompiled.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added a signature SYNCHRONOUS_SOCKET to basis.cm. This is like SOCKET but excludes all non-blocking operations. Defined SOCKET (in Basis) and CML_SOCKET in terms of SYNCHRONOUS_SOCKET. Removed superfluous implementations of non-blocking operations from CML’s Socket structure.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made a new interim version and bootfiles for developer’s bootstrapping convenience.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Made a new interim version and bootfiles for developer’s bootstrapping convenience.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Added an entry to the primitive environment (compiler/Semant/statenv/prim.sml) for int32→real64 conversion and added code to compiler/CodeGen/main/mlriscGen.sml to implement it.

Removed some of the "magic" constants in real64.sml and replaced them with code that generates these values from their corresponding integer counterparts.

Made all(?) the slice-related changes to the Basis and made everything compile again…

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Fixed bug in Real.fromLargeInt.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Minor bugfix in config/libinstall (set anchor with path to standalone tool after installing it, otherwise libraries that need ml-lex or ml-yacc won’t compile the first time the installer runs).

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Rewrote large parts of config/install.sh in SML (config/libinstall.sml). Modified config/install.bat to take advantage of it. Also modified config/install.sh (and called it config/new-install.sh) to take advantage of it on Unix systems. (The SML code is (supposed to be) platform- independent.)

The installer can now install everything under Win32 as well as under *nix as long as it compiles.

Other changes:

Made Win32 version of OS.FileSys.fullPath return current directory when given an empty string. This is what the spec says, and incidentally, CM depends on it. (CM otherwise goes into an infinite loop in certain cases when presented with the name of a non-existing .cm file.)

owner:[Matthias Blume,http://www.tti-c.org/blume/]

This is a major update which comes with a version number bump (110.42.99 — yes, we are really close to 110.43 :-), NEW BOOTFILES, and an implementation of IntInf in the Basis.

There are a fairly large number of related changes and updates throughout the system:

Basis: - Implemented IntInf. - Made LargeInt a projection of IntInf (by filtering through INTEGER). - Added some missing Real64 operations, most notably Real.toLargeInt. - Added FixedInt as a synonym for Int32.

compiler: * Added support for a built-in intinf type. - literals - pattern matching - conversion shortcuts (Int32.fromLarge o Int.toLarge etc.) - overloading on literals and operations

Merging changes from the mcz-branch development branch into trunk. These changes involve replacement of the emulated old prettyprinter interface with direct use of the SML/NJ Lib PP library, and fixing of a couple of bugs (895, 1186) relating to error messages. A new prettyprinter for ast datatypes (Elaborator/print/ppast.{sig,sml}) has been added.

owner:[Dave MacQueen]

This patch restores SML/NJ’s ability to run under win32. There are a number of changes, including fixes for several bugs that had gone unnoticed until now:

Modified compiler/Elaborator/print/pptype.sml to fix bug 895. Tag will be used for new development branch (mcz-branch) for use by MacQueen, (Lucasz) Zairek, and (George) Cao at uchicago.

owner:[Dave MacQueen]

Tried to eliminated most cases of polymorphic equality.

owner:[Matthias Blume,http://www.tti-c.org/blume/]

Two changes:

owner:[Allen Leung]

Fixed a bug in Int.rem(x,y) where y is a power of 2 on x86. The arguments to the SUBL instruction were swapped.

owner:[Allen Leung]

Fixed a serious bug in the rewrite code for FP spilling/reloading that sent the RA into an infinite loop when floating point registers get spilled. (Because of this bug, e.g., nucleic stopped compiling between 110.37 and 110.38.) There was another set of potential problems related to the handling of MLRISC annotations (but those did not yet cause real problems, apparently).

owner:[Matthias Blume]

Added a call of SrcPath.sync at the beginning of Parse.parse (in CM). This fixes the problem of CM getting confused by files that suddenly change their identity (e.g., by getting unlinked and recreated by some text editor such as vi). There might be a better/cheaper/cleaner way of doing this, but for now this will have to do.

owner:[Matthias Blume]

Exported structure Typecheck from $smlnj/viscomp/core.cm.

owner:[Matthias Blume]

In good old tradition, there has been a slight hiccup so that we have to patch 110.42 after the fact. The old release tag has been replaced (see below).

The change solves a problem with two competing approaches the configuration problem regarding MacOS 10.1 vs. MacOS 10.2 which got in each other’s way.

This change only affects the runtime system code and the installer script. (No new bootfiles.)

owner:[Matthias Blume]

The mltree operator DIVS must be implemented with an overflow check on the PPC because the hardware indicates divide-by-zero using "overflow" as well.

owner:[Matthias Blume]

Sml now senses the SMLNJ_HOME environment variable. If this is set, then the bin dir is assumed to be in $SMLNJ_HOME/bin and (unless CM_PATHCONFIG is also set), the path configuration file is assumed to be in $SMLNJ_HOME/lib/pathconfig. This way one can easily move the entire tree to some other place and everything will "just work".

(Companion commands such as ml-build and ml-makedepend also sense this variable.)

owner:[Matthias Blume]

Exported two useful "step" functions from liveness module (MLRISC).

owner:[Matthias Blume]

Exported structure BTImp from $smlnj/viscomp/debugprof.cm so that other clients can set up backtracing support.

owner:[Matthias Blume]

Fixed a bug in translation of INLMAX (and INLMIN) for the floating-point case. (The sense of the isNaN test was reversed — which made min and max always return their first argument.)

owner:[Matthias Blume]

Back-ported OS.Path.{from,to}UnixPath from idlbasis-devel branch.

owner:[Matthias Blume]

I back-ported my implementation of IEEEReal.fromString from the idlbasis-devel branch so that we can test it.

Another small change is that ppDec tries to give more information than just "<sig>" in the case of functors. However, this code is broken in some mysterious way if the functor’s body’s signature has not been declared by ascription but gets inferred from the implementation. This needs fixing…

owner:[Matthias Blume]

Resurrected SMLofNJ.Internals.BTrace.mode. (It accidentally fell by the wayside when I switched over to using Controls everywhere.)

owner:[Matthias Blume]

Labels are now displayed in the graphical output to make the fall-through and target blocks obvious.

owner:[Lal George]

John tweaked yesterday’s fix for 1131 to handle an out-of-memory situation that comes up when allocating huge arrays.

owner:[Matthias Blume]

John Reppy fixed GC bug 1131.

owner:[Matthias Blume]

CM documentation update.

owner:[Matthias Blume]

Added a lot of commented-out suggestions for things to be included in config/preloads.

owner:[Matthias Blume]

o Made the mdl tool stuff compile and run again. o I’ve disabled all the stuff that depends on RTL specifications; they are all badly broken anyway.

owner:[Allen Leung]

owner:[Lal George]

A few minor bugfixes:

Applied the following bugfix provided by Emden Gansner:

owner:[Matthias Blume]

Added full support for div/mod/rem/quot on the x86, using the machine instruction’s two results (without clumsily recomputing the remainder) directly where appropriate.

Some more extensive power-of-two support was added to the x86 instruction selector (avoiding expensive divs, mods, and muls where they can be replaced with cheaper shifts and masks). However, this sort of thing ought to be done earlier, e.g., within the CPS optimizer so that all architectures benefit from it.

The compiler compiles to a fixed point, but changes might be somewhat fragile nevertheless. Please, report any strange things that you might see wrt. div/mod/quot/rem…

owner:[Matthias Blume]

Fixed my broken div/mod logic. Unfortunately, this means that the inline code for div/mod now has one more comparison than before. Fast paths (quotient > 0 or remainder = 0) are not affected, though. The problem was with quotient = 0, because that alone does not tell us which way the rounding went. One then has to look at whether remainder and divisor have the same sign… :(

Anyway, I replaced the bootfiles with fresh ones…

owner:[Matthias Blume]

Primops have changed. This means that the bin/boot-file formats have changed as well.

To make sure that there is no confusion, I made a new version.

+ CHANGES:

Added support for all four division operations (ML’s div, mod, quot, and rem) to MLRISC. In the course of doing so, I also rationalized the naming (no more annoying switch-around of DIV and QUOT), by parameterizing the operation by div_rounding_mode (which can be either DIV_TO_ZERO or DIV_TO_NEGINF).

The generic MLTreeGen functor takes care of compiling all four operations down to only round-to-zero div.

Missing pieces:

I improved (hopefully without breaking them) the implementation of Int.div, Int.mod, and Int.rem. For this, the code in translate.sml now takes advantage of the following observations:

where "quot" is the round-to-zero version of integer division that hardware usually provides. Then we have:

This results in substantial simplification of the generated code. The following table shows the number of CFG nodes and edges generated for fun f (x, y) = x OPER y (* with OPER \in div, mod, quot, rem *)

+ OPER | nodes(old) | edges(old) | nodes(new) | edges(new) -------------------------------------------------------- div | 24 | 39 | 12 | 16 mod | 41 | 71 | 12 | 16 quot | 8 | 10 | 8 | 10 rem | 10 | 14 | 8 | 10

+ owner:[Matthias Blume]

Fixed a bug in cproto (c prototype decoder).

owner:[Matthias Blume]

I did some cleanup to Allen’s new primop code and replaced yesterday’s bootfiles with new ones. (But they are stored in the same place.)

owner:[Matthias Blume]

Made the bootfiles that Allen asked for.

owner:[Matthias Blume]

Implemented the Ball-Larus branch prediction-heuristics, and incorporated graphical viewers for control flow graphs.

Ball-Larus Heuristics:

See the file compiler/CodeGen/cpscompile/cpsBranchProb.sml.

By design it uses the Dempster-Shafer theory for combining probabilities. For example, in the function:

the ball-larus heuristics predicts that the n=0 is unlikely (OH-heuristic), and the then branch is unlikely because of the RH-heuristic — giving the then branch an even lower combined probability using the Dempster-Shafer theory.

Finally, John Reppy’s loop analysis in MLRISC, further lowers the probability of the then branch because of the loop in the else branch.

+ Graphical Viewing:

I merely plugged in Allen’s graphical viewers into the compiler. The additional code is not much. At the top level, saying:

will display the graphical view of the control flow graph just before back-patching. daVinci must be in your path for this to work. If daVinci is not available, then the default viewer can be changed using:

which can be set to "dot" or "vcg" for the corresponding viewers. Of course, these viewers must be in your path.

The above will display the compilation unit at the level of clusters, many of which are small, boring, and un-interesting. Also setting:

will display clusters that are larger than the value set by the above.

+ owner:[Lal George]

Changed the interface to the KMP routine in PreString and fixed a minor bug in one place where it was used.

owner:[Matthias Blume]

owner:[Allen Leung]

Implemented Knuth-Morris-Pratt string matching in PreString and used it for String.isSubstring, Substring.isSubstring, and Substring.position.

(Might need some stress-testing. Simple examples worked fine.)

owner:[Matthias Blume]

Added a structure C.W and functions convert/Ptr.convert to ml-nlffi-lib.

This implements a generic mechanism for changing constness qualifiers anywhere within big C types without resorting to outright "casts". (So far, functions such as C.rw/C.ro or C.Ptr.rw/C.Ptr.ro only let you modify the constness at the outermost level.) The implementation of "convert" is based on the idea of "witness" values — values that are not used by the operation but whose types "testify" to their applicability. On the implementation side, "convert" is simply a projection (returning its second curried argument). With cross-module inlining, it should not result in any machine code being generated.

owner:[Matthias Blume]

Provided (preliminary?) implementations for

and

Those are in the Basis spec but they were missing in SML/NJ.

owner:[Matthias Blume]

Controls:

Bug fix for:

The problem was that the code generator did not generate any fp registers in this case, and the ra didn’t know that it needed to run the X86FP phase to translate the pseudo fp instruction. This only happened with unary fp operators in certain situations.

owner:[Allen Leung]

Forgot to update BOOT and srcarchiveurl.

owner:[Matthias Blume]

Yet another version number bump (because of small changes to the binfile format). Version number is now 110.39.2. NEW BOOTFILES!

Changes:

owner:[Matthias Blume]

Integrated jump chaining and static block frequency into the compiler. More details and numbers later.

owner:[Lal George]

Tested the jump chain elimination on all architectures (except the hppa). This is on by default right now and is profitable for the alpha and x86, however, it may not be profitable for the sparc and ppc when compiling the compiler.

The gc test will typically jump to a label at the end of the cluster, where there is another jump to an external cluster containing the actual code to invoke gc. This is to allow factoring of common gc invocation sequences. That is to say, we generate:

+ After jump chain elimination the ja L1 instructions is converted to ja L2. On the sparc and ppc, many of the ja L2 instructions may end up being implemented in their long form (if L2 is far away) using:

+ For large compilation units L2 may be far away.

+ owner:[Lal George]

A functor parameter was missing.

owner:[Matthias Blume]

owner:[Allen Leung]

owner:[Allen Leung]

Entrypoints: non-zero offset into a code object where execution should begin.

This is a very large but mostly boring patch which makes (almost) every tuneable compiler knob (i.e., pretty much everything under Control.* plus a few other things) configurable via both the command line and environment variables in the style CM did its configuration until now.

Try starting sml with -h (or, if you are brave, -H)

To this end, I added a structure Controls : CONTROLS to smlnj-lib.cm which implements the underlying generic mechanism.

The interface to some of the existing such facilities has changed somewhat. For example, the MLRiscControl module now provides mkFoo instead of getFoo. (The getFoo interface is still there for backward-compatibility, but its use is deprecated.)

The ml-build script passes -Cxxx=yyy command-line arguments through so that one can now twiddle the compiler settings when using this "batch" compiler.

TODO items:

We should go through and throw out all controls that are no longer connected to anything. Moreover, we should go through and provide meaningful (and correct!) documentation strings for those controls that still are connected.

Currently, multiple calls to Controls.new are accepted (only the first has any effect). Eventually we should make sure that every control is being made (via Controls.new) exactly once. Future access can then be done using Controls.acc.

Finally, it would probably be a good idea to use the getter-setter interface to controls rather than ref cells. For the time being, both styles are provided by the Controls module, but getter-setter pairs are better if thread-safety is of any concern because they can be wrapped.

Other assorted changes (by other people who did not supply a HISTORY entry):

Tested the weighted block placement optimization on all architectures (except the hppa) using AMPL to generate the block and edge frequencies. Changes were required in the machine properties to correctly categorize trap instructions. There is an MLRISC flag "weighted-block-placement" that can be used to enable weighted block placement, but this will be ineffective without block/edge frequencies (coming soon).

+ owner:[Lal George]

In order to support the block placement optimization, a new cluster is generated as the very first cluster (called the linkage cluster). It contains a single jump to the real entry point for the compilation unit. Block placement has no effect on the linkage cluster itself, but all the other clusters have full freedom in the manner in which they reorder blocks or functions.

On the x86 the typical linkage code that is generated is: ---------------------- .align 2 L0: addl $L1-L0, 72(%esp) jmp L1

+ .align 2 L1: ----------------------

72(%esp) is the memory location for the stdlink register. This must contain the address of the CPS function being called. In the above example, it contains the address of L0; before calling L1 (the real entry point for the compilation unit), it must contain the address for L1, and hence

I have tested this on all architectures except the hppa.The increase in code size is of course negligible

owner:[Lal George]

owner:[Allen Leung]

This is a new implementation of the CPS spill phase. The new phase is in the new file compiler/CodeGen/cpscompile/spill-new.sml In case of problems, replace it with the old file spill.sml

The current compiler runs into some serious performance problems when constructing a large record. This can happen when we try to compile a structure with many items. Even a very simple structure like the following makes the compiler slow down.

The following table shows the compile time, from N=1000 to N=4000, with the old compiler:

N 1000 CPS 100 spill 0.04u 0.00s 0.00g MLRISC ra 0.06u 0.00s 0.05g (spills = 0 reloads = 0) TOTAL 0.63u 0.07s 0.21g

1100 CPS 100 spill 8.25u 0.32s 0.64g MLRISC ra 5.68u 0.59s 3.93g (spills = 0 reloads = 0) TOTAL 14.71u 0.99s 4.81g

1500 CPS 100 spill 58.55u 2.34s 1.74g MLRISC ra 5.54u 0.65s 3.91g (spills = 543 reloads = 1082) TOTAL 65.40u 3.13s 6.00g

2000 CPS 100 spill 126.69u 4.84s 3.08g MLRISC ra 0.80u 0.10s 0.55g (spills = 42 reloads = 84) TOTAL 129.42u 5.10s 4.13g

3000 CPS 100 spill 675.59u 19.03s 11.64g MLRISC ra 2.69u 0.27s 1.38g (spills = 62 reloads = 124) TOTAL 682.48u 19.61s 13.99g

4000 CPS 100 spill 2362.82u 56.28s 43.60g MLRISC ra 4.96u 0.27s 2.72g (spills = 85 reloads = 170) TOTAL 2375.26u 57.21s 48.00g

As you can see the old cps spill module suffers from some serious performance problem. But since I cannot decipher the old code fully, instead of patching the problems up, I’m reimplementing it with a different algorithm. The new code is more modular, smaller when compiled, and substantially faster (O(n log n) time and O(n) space). Timing of the new spill module:

4000 CPS 100 spill 0.02u 0.00s 0.00g MLRISC ra 0.25u 0.02s 0.15g (spills=1 reloads=3) TOTAL 7.74u 0.34s 1.62g

Implementation details:

As far as I can tell, the purpose of the CPS spill module is to make sure the number of live variables at any program point (the bandwidth) does not exceed a certain limit, which is determined by the size of the spill area.

When the bandwidth is too large, we decrease the register pressure by packing live variables into spill records. How we achieve this is completely different than what we did in the old code.

First, there is something about the MLRiscGen code generator that we should be aware of:

MLRiscGen performs code motion!

Secondly, there are now two new cps primops at our disposal:

We use these new primops for both spilling and increment record construction.

owner:[Allen Leung]

Minor bug fixes in the parser and rewriter

owner:[Allen Leung]

Regenerated the peephole files. Some contained typos in the specification and some didn’t compile because of pretty printing bugs in the old version of nowhere.

owner:[Allen Leung]

A wild mix of changes, some minor, some major:

Applied Chris Okasaki’s bug fix for priority queues.

owner:[Matthias Blume]

Added EnvRef.listBoundSymbols and CM.State.showBindings. Especially the latter can be useful for exploring what bindings are available at the interactive prompt. (The first function returns only the list of symbols that are really bound, the second prints those but also the ones that CM’s autoloading mechanism knows about.)

owner:[Matthias Blume]

Two improvements to ml-nlffigen:

Added a type t t_ to tag.sml (in ml-nlffi-lib.cm). This is required because of the new and improved tag generation scheme. (Thanks to Allen Leung for pointing it out.)

owner:[Matthias Blume]

Fixed the MLRISC bug sent by Markus Wenzel regarding the compilation of Isabelle on the x86.

From Allen:

Fixed a bug in ml-nlffigen that was introduced with one of the previous updates.

owner:[Matthias Blume]

Added new priority queue export symbols (which have just been added to smlnj-lib.cm) to CML’s version of smlnj-lib.cm. (Otherwise CML would not compile and the installer would choke.)

owner:[Matthias Blume]

Added a "-gensym" option to command line of ml-nlffigen. This can be used to specify a "stem" — a string that is inserted in all "gensym’d" names (ML structure names that correspond to unnamed C structs, unions, and enums), so that separate runs of ml-nlffigen do not clash.

owner:[Matthias Blume]

A quick fix for a problem with GenSML (in the pgraph-util library): Make generation of toplevel "local" optional. (Strictly speaking, signature definitions within "local" are not legal SML.)

Other than that: updates to INSTALL and cm/TODO.

owner:[Matthias Blume]

Compilers that generate assembly code may produce global labels whose value is resolved at link time. The various peephole optimization modules did not take this in account.

TODO. The Labels.addrOf function should really return an option type so that clients are forced to deal with this issue, rather than an exception being raised.

owner:[Lal George]

owner:[Allen Leung]

John Reppy: Changes c-calls API to accept client-callback for allocating extra stack space. me: Corresponding changes to mlriscGen (using a dummy argument that does not change the current behavior).

owner:[Matthias Blume]

owner:[Allen Leung]

Call it a (working) release! Version is 110.38. Bootfiles are ready.

README will be added later.

!!! NOTE: Re-tagged as blume-Release_110_38-retracted. Original tag (Release_110_38) removed. Reason: Last-minute bug fixes.

owner:[Matthias Blume]

A large number of tweaks and improvements to ml-nlffi-lib and ml-nlffigen:

owner:[Lal George]

Bug fix for c-calls on x86 (having to do with how char- and short-arguments are being handled).

owner:[Matthias Blume]

Another day of fiddling with the FFI…

Made config/srcarchiveurl point to a new place. (Will provide boot files shortly.)

Maybe we christen this to be 110.38?

owner:[Matthias Blume]

Today’s FFI fiddling:

Now that x86-fast-fp seems to be working, I turned it back on again by default. (Seems to work fine now, even with the FFI.)

Other than that, I added some documentation about the FFI to src/ml-nlffigen/README and updated the FFI test examples in src/ml-nlffi-lib/Tests/*.

owner:[Matthias Blume]

More fiddling with the FFI interface:

owner:[Lal George]

Changed the representation of instructions from being fully abstract to being partially concrete. That is to say:

This makes the handling of certain special instructions that appear on all architectures easier and uniform.

LIVE and KILL say that a list of registers are live or killed at the program point where they appear. No spill code is generated when an element of the regs field is spilled, but the register is moved to the spilled (which is present, more for debugging than anything else).

LIVE replaces the (now deprecated) DEFFREG instruction on the alpha. We used to generate:

but now generate:

Furthermore, the DEFFREG (hack) required that all floating point instruction use all registers mentioned in the instruction. Therefore f1 := f2 + f3, defines f1 and uses [f1,f2,f3]! This hack is no longer required resulting in a cleaner alpha implementation. (Hopefully, intel will not get rid of this architecture).

COPYXXX is intended to replace the parallel COPY and FCOPY available on all the architectures. This will result in further simplification of the register allocator that must be aware of them for coalescing purposes, and will also simplify certain aspects of the machine description that provides callbacks related to parallel copies.

ANNOTATION should be obvious, and now INSTR represents the honest to God machine instruction set!

The <arch>/instructions/<arch>Instr.sml files define certain utility functions for making porting easier — essentially converting upper case to lower case. All machine instructions (of type instr) are in upper case, and the lower case form generates an MLRISC instruction. For example on the alpha we have:

where lda is just (INSTR o LDA), etc.

owner:[Lal George]

Removed the "Release_110_37" tag because of a serious bug. This will be re-tagged once the bug is fixed.

owner:[Matthias Blume]

Forgot to add a file. (Just a .tex-file — part of the CM manual source.)

owner:[Matthias Blume]

Note: I removed the original tag "Release_110_37" from this commit because we found a serious bug in all non-x86 backends. - Matthias

owner:[Lal George]

owner:[Lal George]

CKIT: * Changed the "Function" constructor of type Ast.ctype to carry optional argument identifiers. * Changed the return type of TypeUtil.getFunction accordingly. * Type equality ignores the argument names. * TypeUtil.composite tries to preserve argument names but gives up quickly if there is a mismatch.

installation script: * attempts to use "curl" if available (unless "wget" is available as well)

CM: * has an experimental implementation of "portable graphs" which I will soon propose as an implementation-independent library format * there are also new libraries $/pgraph.cm and $/pgraph-util.cm

NLFFI-LIB: * some cleanup (all cosmetic)

NLFFIGEN: * temporarily disabled the mechanism that suppresses ML output for C definitions whose identifiers start with an underscore character * generate val bindings for enum constants * user can request that only one style (light or heavy) is being used; default is to use both (command-line arguments: -heavy and -light) * fixed bug in handling of function types involving incomplete pointers * generate ML entry points that take record arguments (i.e., using named arguments) for C functions that have a prototype with named arguments (see changes to CKIT)

owner:[Matthias Blume]

owner:[Allen Leung]

Underscore patch from Chris Richards (fixing problem with compiling runtime system under recent NetBSD).

owner:[Matthias Blume]

X86RA now uses a valid (instead of dummy) PrintFlowgraph module.

owner:[Allen Leung]

The representation of a program point never expected to see more than 65536 instructions in a basic block!

owner:[Lal George]

Changed the machine description files to support printing of local and global labels in assembly code, based on host assembler conventions.

owner:[Lal George]

I provided a non-hook implementation of exnName (at the toplevel) and made the "dummy" implementation of exnMessage (at the toplevel) more useful: if nothing gets "hooked in", then at least you are going to see the exception name and a message indicating why you don’t see more.

[For the time being, programs that need exnMessage and want to use ml-build should either use General.exnMessage (strongly recommended) or refer to structure General at some other point so that CM sees a static dependency.]

[Similar remarks go for "print" and "use": If you want to use their functionality in stand-alone programs generated by ml-build, then use TextIO.output and Backend.Interact.useFile (from $smlnj/compiler.cm).]

owner:[Matthias Blume]

Allen says that x86-fast-fp is not safe yet, so I turned it off again…

owner:[Matthias Blume]

John committed some changes that Allen made, in particular a (hopefully) correctly working version of the x86-fp module.

I changed the default setting of the Control.MLRISC.getFlag "x86-fast-fp" flag to "true". Everything seems to compile to a fixpoint ok, and "mandelbrot" speeds up by about 15%.

owner:[Matthias Blume]

Fix for bug 1581, received from Neophytos Michael.

owner:[Matthias Blume]

owner:[Lal George]

I forgot to commit a few files. Here they are…

owner:[Matthias Blume]

!!!! NEW BOOTFILES !!!!

This is another round of reorganizing the compiler sources. This time the main goal was to factor out all the "instrumentation" passes (for profiling and backtracing) into their own library. The difficulty was to do it in such a way that it does not depend on elaborate.cm but only on elabdata.cm.

Therefore there have been further changes to both elaborate.cm and elabdata.cm — more "generic" things have been moved from the former to the latter. As a result, I was forced to split the assignment of numbers indicating "primtyc"s into two portions: SML-generic and SML/NJ-specific. Since it would have been awkward to maintain, I bit the bullet and actually changed the mapping between these numbers and primtycs. The bottom line of this is that you need a new set of bin- and bootfiles.

I have built new bootfiles for all architectures, so doing a fresh checkout and config/install.sh should be all you need.

The newly created library’s name is

and its sources live under

owner:[Matthias Blume]

This is a first cut at reorganizing the CM libraries that make up the core of the compiler. The idea is to separate out pieces that could be used independently by tools, e.g., the parser, the typechecker, etc.

The current status is a step in this direction, but it is not quite satisfactory yet. Expect more changes in the future.

Here is the current (new) organization…

Notes:

I am not 100% happy with the way I separated the elaborator (and its data structures) from FLINT. Two instances of the same problem:

This fix was sent to us by Zhong Shao. It is supposed to improve the performance of certain loops by avoiding needless closure allocation.

owner:[Matthias Blume]

owner:[Lal George]

I have dramatically simplified the interface for CELLS in MLRISC.

In summary, the cells interface is broken up into three parts:

This update puts together a fairly extensive but straightforward change to the way the libraries that implement the interactive system are organized:

Aside from these changes to library organization, there are also changes to the way the code itself is organized:

CM documentation has been updated to reflect the changes to library organization.

owner:[Matthias Blume]

Minor tweak to 110.34 (re-tagged):

I changed the handling of varargs in ml-nlffigen again: The ellipsis … will now simply be ignored (with an accompanying warning).

The immediate effect is that you can actually call a varargs function from ML — but you can’t actually supply any arguments beyond the ones specified explicitly. (For example, you can call printf with its format string, but you cannot pass additional arguments.)

This behavior is only marginally more useful than the one before, but it has the advantage that a function or, more importantly, a function type never gets dropped on the floor, thus avoiding follow-up problems with other types that refer to the offending one.

owner:[Matthias Blume]

Fixed a small bug in CM’s handling of parallel compilation. (You could observe the bug by Control-C-interrupting an ordinary CMB.make or CM.stabilize and then attaching some compile servers. The result was that all of a sudden the previously interrupted compilation would continue on its own. This was because of an over-optimization: CM did not bother to clean out certain queues when no servers were attached "anyway", resulting in the contents of these queues to grab control when new servers did get attached.)

There is also another minor update to the CM manual.

owner:[Matthias Blume]

Minor typo fixed in CM manual (syntax diagram for libraries).

owner:[Matthias Blume]

Fixed a nasty bug in the X86 assembly code that caused signal handlers to fail (crash) randomly.

owner:[Matthias Blume]

This update fixes a number of minor bugs in ml-nlffigen as reported by Nick Carter <nbc@andrew.cmu.edu>.

eXene now compiles and (sort of) works again.

The library name (for version > 110.33) is $/eXene.cm.

I also added an new example in src/eXene/examples/nbody. See the README file there for details.

owner:[Matthias Blume]

CML now compiles and works again.

Libraries (for version > 110.33):

The installer (config/install.sh) has been taught how to properly install this stuff.

owner:[Matthias Blume]

This un-breaks the fix for bug 1432. (The bug was originally fixed in 110.9 but I broke it again some time after that.)

owner:[Matthias Blume]

This should (hopefully) fix the long-standing signal handling bug. (The runtime system was constructing a continuation record with an incorrect descriptor which would cause the GC to drop data on the floor…)

owner:[Matthias Blume]

Here is a short late-hour update related to Sparc c-calls:

owner:[Matthias Blume]

The purpose of this update is to provide an implementation of NLFFI on Sparc machines.

Here are the changes in detail:

A number of internal changes related to C calls and calling conventions:

This is mostly a cleanup of MLFFI stuff:

Made install.sh use file config/targets.customized if it exists, falling back to config/targets if it doesn’t. This way one can have a customized version of the targets file without touching the "real thing", thus eliminating the constant fear of accidentally checking something bogus back into the CVS repository… (File config/targets.customized must not be added to the repository!)

owner:[Matthias Blume]

Some bugs in install script fixed.

In addition to that I also made a slight change to the NLFFI API: Functors generated by ml-nlffigen now take the dynamic library as a straight functor argument, not as a suspended one. (The original functor code used to force the suspension right away anyway, so there was nothing gained by this complication of the interface.)

owner:[Matthias Blume]

I finally took the plunge and added my new FFI code to the main repository. For x86-linux it is now ready for prime-time.

There are two new subdirectories of "src":

Fixed a bug in the accounting code in cpsopt/contract.sml. (The wrapper/unwrapper elimination did not decrement usage counts and some dead variables got overlooked by the dead-up logic.)

owner:[Matthias Blume]

Changes to implement the omit-frame-pointer optimization to support raw C calls. For now, there is only support on the Intel x86, but other architectures will follow as more experience is gained with this.

+ owner:[Lal George]

I made into "proxy libraries" all libraries that qualify for such a change. (A qualifying library is a library that has another library or groups as its sole member and repeats that member’s export list verbatim. A proxy library avoids this repetition by omitting its export list, effectively inheriting the list that its (only) member exports. See the CM manual for more explanation.) The main effect is that explicit export lists for these libraries do not have to be kepts in sync, making maintenance a bit easier.

I also added copyright notices to many .cm-files.

Last but not least, I made a new set of bootfiles.

owner:[Matthias Blume]

Changed install.sh to use the current working directory instead of /usr/tmp for a temporary file (pcedittmp). The previous choice of /usr/tmp caused trouble with MacOS X because of file premission problems.

owner:[Matthias Blume]

Created a new set of bootfiles (for your automatic installation convenience).

owner:[Matthias Blume]

Parallel make (using compile servers) now works again.

To this end, CM.stabilize and CMB.make have been modified to work in two passes when compile servers are attached: 1. Compile everything, do not perform stabilization; this pass uses compile servers 2. Stabilize everything; this pass does not use compile servers If there are no compile servers, the two passes are combined into one (as before). Splitting the passes increases the inherent parallelism in the dependency graph because the entire graph including all libraries is available at the same time. This, in turn, improves server utilization. The downside is that the master process will have to do some extra work after compilation is done (because for technical reasons it must re-read all the binfiles during stabilization).

owner:[Matthias Blume]

Created a new set of bootfiles (for your automatic installation convenience).

owner:[Matthias Blume]

This is a minor fixup for an (untagged) earlier commit by Allen. (A file was missing).

owner:[Matthias Blume]

This is just a minor update to sync my devel branch with the main brach. The only visible change is the addition of some README files.

owner:[Matthias Blume]

Made a new set of bootfiles that goes with the current state of the repository.

owner:[Matthias Blume]

I am just flushing out some minor changes that had accumulated in my private branch in order to sync with the main tree. (This is mainly because I had CVS trouble when trying to merge into my private branch.)

Most people should be completely unaffected by this.

owner:[Matthias Blume]

The RCC stuff now seems to work (but only on the x86). This required hacking of the c-calls interface (and -implementation) in MLRISC.

Normal compiler users should be unaffected.

owner:[Matthias Blume]

This is a fairly big patch, flushing out a large number of pending changes that I made to my development copy over the last couple of days.

Of practical relevance at this moment is a workaround for a pickling bug that Allen ran into the other day. The cause of the bug itself is still unknown and it might be hard to fix it properly, but the workaround has some merits of its own (namely somewhat reducing pickling overhead for certain libraries). Therefore, I think this solution should be satisfactory at this time.

The rest of the changes (i.e., the vast majority) has to do with my ongoing efforts of providing direct support for C function calls from ML. At the moment there is a new primop "RAW_CCALL", typing magic in types/cproto.sml (invoked from FLINT/trans/translate.sml), a new case in the FLINT CPS datatype (RCC), changes to cps/convert.sml to translate uses of RAW_CCALL into RCC, and changes to mlriscGen.sml to handle RCC.

The last part (the changes to mlriscGen.sml) are still known to be wrong on the x86 and not implemented on all other architectures. But the infrastructure is in place. I had to change a few functor signatures in the backend to be able to route the CCalls interface from MLRISC there, and I had to specialize the mltree type (on the x86) to include the necessary extensions. (The extensions themselves were already there and redy to go in MLRISC/x86).

Everything should be very happy as soon as someone helps me with mlriscGen.sml…

In any case, nothing of this should matter to anyone as long as the new primop is not being used (which is going to be the case unless you find it where I hid it :). The rest of the compiler is completely unaffected.

owner:[Matthias Blume]

Added some experimental support for work that I am doing right now. These changes mostly concern added primops, but there is also a new experimental C library in the runtime system (but currently not enabled anywhere except on Linux/X86).

In the course of adding primops (and playing with them), I discovered that Zhong’s INL_PRIM hack (no type info for certain primops) was, in fact, badly broken. (Zhong was very right he labeled this stuff as "major gross hack".) To recover, I made type information in INL_PRIM mandatory and changed prim.sml as well as built-in.sml accordingly. The InLine structure now has complete, correct type information (i.e., no bottom types).

Since all these changes mean that we need new binfiles, I also bumped the version number to 110.32.1.

owner:[Matthias Blume]

Added proxy libraries for MLRISC and let MLRISC libraries refer to each other using path anchors. (See CM manual for explanation.)

Updated CM documentation.

Fixed some bugs in CM.

Implemented "proxy" libraries (= syntactic sugar for CM).

Added "-quiet" option to makeml and changed runtime system accordingly.

Added cleanup handler for exportML to reset timers and compiler stats.

owner:[Matthias Blume]

owner:[Lal George]

Corrected wording and formatting of some CM warning message which I broke in my previous patch.

owner:[Matthias Blume]

Fixed CM’s handling of anchor environments in connection with CMB.make.

owner:[Matthias Blume]

Removed src/cm/ffi which does not (and did not) belong here.

owner:[Matthias Blume]

Probably most important: CM no longer silently swallows all exceptions in the compiler. Plus: some other minor CM changes. For example, CM now reports some sizes for generated binfiles (code, data, envpickle, lambdapickle).

owner:[Matthias Blume]

owner:[Allen Leung]

owner:[Allen Leung]

Major MLRISC internal changes. Affect all clients. Summary:

Some manual updates and some file reorganizations in CM.

owner:[Matthias Blume]

Drastically improved link traversal code for the case that the dynamic value was already loaded at bootstrap time. As a result, CM and CMB now both load blazingly fast — even on a very slow machine. Also, memory consumption has been further reduced by this.

Warning: The format of the PIDMAP file has changed. THerefore, to bootstrap you have to do this:

Continued hacking on autoloading problem — with success this time. Also changed tool-plugin mechanism. See new CM manual.

owner:[Matthias Blume]

Some hacking to make autoloading faster. Success for CMB, no success so far for CM. There is a reduced structure CM' that autoloads faster. (This is a temporary, non-documented hack to be eliminated again when the general problem is solved.)

owner:[Matthias Blume]

A new x86 floating point code generator has been added. By default this is turned off. To turn this on, do:

Changes:

Eliminated some code duplication: