Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/moses-smt/vowpal_wabbit.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
path: root/io.cc
AgeCommit message (Collapse)Author
2009-12-31Added some includesJohn Langford
2009-12-11Adding support for compression using zlib/gzipShravan M Narayanamurthy
Abstracted all direct access to opening, closing, resetting, flushing, reading & writing files of io_buf into access through a function of io_buf which have all been declared virtual. Now that these accesses have been abstracted out, adding a new type of io_buf, in this case, comp_io_buf, is pretty easy. Just public inherit io_buf and override the default definitions of these virtual functions to work with compressed files. There is a nuance in this because of the current use of multiple files. The 'files' v_array is conveniently typed to int. So in the comp_io_buf, I hold a v_array of gzFiles whose indices are stored in 'files' v_array. Have introduced a new boolean flag compressed into parse_args. The input & output io_bufs in parser are now just pointers that will point to comp_io_buf if the compressed option is chosen. This is the root cause of most of the changes involving parser::input & parser::output. Because of the design of zlib which allows gzread to read from a normal file we can read from a mix of compressed and uncompressed files(cache) without extra logic.
2009-11-25made compile on fedora 11John Langford
2009-09-02Fixed caching to work better.John Langford
2009-09-01Revamped IO so that inputs and caching are independent, and multiple caches ↵John Langford
can be used as inputs.
2009-08-31Fixed bad input assignment bug.John Langford
2009-08-31debugging odd cluster bugJohn Langford
2009-08-05Include file minimization.John Langford
2009-08-01Initial release of version 3.10. I've incorporated some of theJohn Langford
Gordon's changes.
2009-04-30initial check inGordon Rios