Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
auto3dem:history [2015/03/29 16:01] gcardone |
auto3dem:history [2015/12/22 12:59] gcardone |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Modification history ====== | ====== Modification history ====== | ||
| - | This document describes incremental modifications made to the Baker lab software suite. Since the image preprocessing, image reconstruction, format conversion, and utility programs are so tightly coupled (e.g. shared standards and libraries) and released as a single package, all modifications are described together in a single document. Owing to the complexity of the software, it is impractical to provide a line-by-line listing of alterations. Instead we focus primarily on modifications that impact the end user and on large-scale changes to the code. Starting on version 4.02, more details on some of the listed changes can be found in the file MINOR_RELEASE_NOTES, included in the software package. | + | This document describes incremental modifications made to the Baker lab software suite. Since the image preprocessing, image reconstruction, format conversion, and utility programs are so tightly coupled (e.g. shared standards and libraries) and released as a single package, all modifications are described together in a single document. Owing to the complexity of the software, it is impractical to provide a line-by-line listing of alterations. Instead we focus primarily on modifications that impact the end user and on large-scale changes to the code. Starting on version 4.02, more details on the changes in the latest version can be found in the file MINOR_RELEASE_NOTES, included in the software package. |
| + | |||
| + | ==== auto3dem v4.05.2 ==== | ||
| + | |||
| + | == New programs == | ||
| + | * **prj**: calculate projections from a reconstruction using orientations either random, uniform or from an input data set | ||
| + | * **a3dm_icosrotate**: rotate an icosahedral map from standard orientation to one with a pair of vertices positioned along the z axis | ||
| + | * **a3dm_dat_stats**: gather information on the results from a run at a given iteration | ||
| + | * **a3dm_sel_stableparts**: select only stable particles, i.e. with unchanged orientation with respect to a previous iteration, and generate a new stack parameter file | ||
| + | * **a3dm_plot_score**: generate a histogram of the particle scores at a given iteration | ||
| + | * **a3dm_mg_inspect_prepare**: generate auxiliary info and images for screening micrographs using //a3dm_mg_inspect// | ||
| + | * **a3dm_mg_inspect**: quickly inspect and screen micrographs by means of a graphical interface | ||
| + | * **avemaps**: compute average of input maps (replaces mergemaps and mergemaps2) | ||
| + | |||
| + | == General modifications== | ||
| + | * improved handling of cyclic and dihedral symmetries | ||
| + | * added program a3dm_snapshot to gather information about a run, to send to developers for troubleshooting | ||
| + | * particles read from stack files are now background-subtracted | ||
| + | |||
| + | == Random Model Computation == | ||
| + | * use inner radius given as input to **setup_rmc** to mask reference maps at each iteration | ||
| + | * suppressed non significant warnings | ||
| + | |||
| + | == auto3dem == | ||
| + | * added option //po2r mask_map// to specify a binary mask to use for mask-focused refinement | ||
| + | * added option //auto evod_parallel// to specify if processing of even- and odd-numbered particles to be done concurrently | ||
| + | * added option //p3dr cpu_sparse// to specify if to spread cpus among different nodes to optimize resources for large maps (works only on multi-node clusters with pbs/sge queue systems) | ||
| + | * modified approach to define radial mask on maps (only ppft and hollow procedures): search of outer radius starts from radius with minimum standard deviation | ||
| + | |||
| + | == autopp == | ||
| + | * :!: restored option //D// to original interpolation and moved binning procedure to option //H// | ||
| + | * options 5 and 6: keep all info in first line of .dat files | ||
| + | * option 6: fixed bug when processing stacks with only one particle | ||
| + | * option j: when scaling, adjust also pixel size in .dat files | ||
| + | |||
| + | == PPFT == | ||
| + | * figure of merit calculated in double precision | ||
| + | |||
| + | == POR == | ||
| + | * avoid overflow error with metric/funcmode 0 | ||
| + | * change metric 1 to normalized version | ||
| + | * use the same user-defined metric for origin refinement | ||
| + | |||
| + | == maskmap == | ||
| + | * added option to apply the inverse of input mask | ||
| + | |||
| + | == rot_map == | ||
| + | * input shifts now expected as pixels | ||
| + | * improved estimate of the background value | ||
| + | * write the map in a format compatible with **p3dr** | ||
| + | |||
| + | == a3dm_plot_fsc == | ||
| + | * estimate resolution at threshold value by linear interpolation | ||
| + | * added option //-c/--cutoff// to specify threshold value where to estimate the resolution | ||
| + | |||
| + | ==== auto3dem v4.05.1 ==== | ||
| + | |||
| + | == Installation == | ||
| + | * changed installation procedure: **auto3dem_install** is the new command | ||
| + | * made easy to add support for new compilers | ||
| + | |||
| + | == New programs == | ||
| + | * **maskmap**: apply an input binary mask after adding a soft edge | ||
| + | |||
| + | == Random Model Computation == | ||
| + | * a minimum number of micrographs is used to generate an initial model. This value can be controlled by option //-nmgmin// in **setup_rmc** | ||
| + | * initial master file contains commented line for limiting number of cpus used at reconstruction | ||
| + | |||
| + | == General modifications == | ||
| + | * provided binary for CTFFIND4 in the package (Linux only) | ||
| + | * at start programs will display if compiled in parallel or serial mode | ||
| + | * maps are flattened with a soft mask, using full map as reference for masking in gold standard | ||
| + | * inconsistency of pixel size in map header does not throw an error anymore | ||
| + | |||
| + | == auto3dem == | ||
| + | * added parameter to control the soft edge with solvent flattening (//auto flatten_falloff//) | ||
| + | * keep input/output files used by flatten and hollow procedure | ||
| + | * continue parameter file generated at end of each run has now unique name to avoid overwriting and to keep track of the processing | ||
| + | |||
| + | == autopp == | ||
| + | * :!: option //D// modified to perform binning of micrographs instead of interpolation | ||
| + | * added experimental option 3x in autopp for using ctffind4 | ||
| + | |||
| + | == robem == | ||
| + | * added option for performing binning in batch mode (//-bin//) | ||
| + | * improved font appearance | ||
| + | * remove unused read/write menus | ||
| + | * added warning if can not connect to display | ||
| + | * minor fixes on size of file names | ||
| + | * avoid including origin when calibrating maps for subtraction | ||
| ==== auto3dem v4.05 ==== | ==== auto3dem v4.05 ==== | ||
| Line 8: | Line 97: | ||
| == Installation == | == Installation == | ||
| + | * added installation script for Mac OSX | ||
| * added installation instructions for Mac OSX | * added installation instructions for Mac OSX | ||
| + | |||
| + | == new programs == | ||
| + | * **a3dm_plot_fsc.py**: plot FSC curves from a given set of iterations | ||
| + | * **a3dm_fsc2xml.py**: convert FSC curve to EMDB-compatible XML format | ||
| + | |||
| + | == auto3dem == | ||
| + | * changed method to identify score to use for selection of particles | ||
| + | * setup_rmc now prepares parameter files for gold standard procedure | ||
| + | * map radial profile is avoided if new_ptles set | ||
| + | * move the parameter updates outside of even/odd loops | ||
| + | * make sure that parameter files are complete with particles for gold standard | ||
| + | * fixed bug when estimating mask radii and changed constant factor for outer radius | ||
| == autopp == | == autopp == | ||
| + | * added option 6 to split parameters into even and odd numbered particles | ||
| * option j: handle multistack parameter files | * option j: handle multistack parameter files | ||
| * option 6: check presence of 'dat' in parameter file names | * option 6: check presence of 'dat' in parameter file names | ||
| * option 6: handle files not containing _ character when splitting into even/odd files | * option 6: handle files not containing _ character when splitting into even/odd files | ||
| + | * option 6: make up particle parameters when splitting empty files | ||
| + | * options F and O: added option to delete input files once processed | ||
| + | * option 5: fixed split and join of parameter files | ||
| + | * option K: remove box size from first line of dat files | ||
| + | * added option for not masking corners when generating/processing stacks | ||
| + | * option j: remove box size info from first line of dat files | ||
| + | * option 3 (ctffind): remove unused variable pave | ||
| - | robem: add -fastload to avoid calculation of radial profiles | + | == P3DR == |
| + | * increased output format size for pixel count | ||
| - | == new programs == | + | == PSF == |
| - | * added a3dm_plot_fsc.py and a3dm_fsc2xml.py | + | * handle large maps |
| - | 2014-12-22 | + | |
| - | gcardone | + | == PPFT == |
| - | 6a3e5c2 | + | * added warning messages during initialization |
| - | robem: calculate radial profile also for maps loaded for comparison (Subtract 3D Map menu) | + | * fix error messages in get_info module |
| - | 2014-12-22 | + | * constrained shift values in output dat files |
| - | gcardone | + | * improved logs and check controls |
| - | bcfe655 | + | * fixed index bug for compare_mode 1 (mode not currently used) |
| - | robem: change map_1d_rob to calc_map_1d_profile and simplify interface | + | |
| - | robem: allow large indexes when reading integer maps | + | == POR == |
| - | 2014-12-19 | + | * constrained shift values in output dat files |
| - | gcardone | + | |
| - | eff1fc3 | + | == tiff2pif == |
| - | robem: changed window parameters to avoid colored stripes in the gui | + | * fixed interface and handle endianess |
| - | 2014-12-18 | + | |
| - | gcardone | + | == dm32pif == |
| - | 5594925 | + | * accept unsigned integer format |
| - | robem: fix radial projection for large maps | + | |
| - | 2014-12-12 | + | == robem == |
| - | gcardone | + | * added -fastload to avoid calculation of radial profiles |
| - | 30eb9a1 | + | * calculate radial profile also for maps loaded for comparison (Subtract 3D Map menu) |
| - | robem: allow initialization of large arrays | + | * redefined //map_1d_rob// as //calc_map_1d_profile//, and simplified its interface |
| - | 2014-12-12 | + | * allow initialization of large arrays |
| - | gcardone | + | * allow opening of large maps |
| - | a76e8b2 M | + | * allow large indexes when reading integer maps |
| - | merge | + | * changed window parameters to avoid colored stripes in the gui |
| - | 2014-12-12 | + | * fix radial projection for large maps |
| - | gcardone | + | * increased buffer display |
| - | 58a94e7 | + | * open stack images even if in different directory than dat file |
| - | allow robem to open large maps | + | |
| - | 2014-12-12 | + | |
| - | gcardone | + | |
| - | 35deca7 | + | |
| - | P3DR: increased output format size for pixel count | + | |
| - | 2014-12-10 | + | |
| - | gcardone | + | |
| - | 8862ffc | + | |
| - | fix number of micrographs in the summary (gold standard) | + | |
| - | 2014-11-26 | + | |
| - | gcardone | + | |
| - | 01f89c3 M | + | |
| - | merge autopp and PSF changes | + | |
| - | 2014-11-21 | + | |
| - | gcardone | + | |
| - | eb15364 | + | |
| - | modify PSF to handle large maps | + | |
| - | 2014-11-21 | + | |
| - | gcardone | + | |
| - | ba75321 | + | |
| - | autopp F and O: add option to delete input files once processed | + | |
| - | 2014-11-14 | + | |
| - | gcardone | + | |
| - | 97a17a5 | + | |
| - | change method to identify score to use for selection of particles | + | |
| - | 2014-11-14 | + | |
| - | gcardone | + | |
| - | 19a9416 | + | |
| - | setup_rmc: prepare data for gold standard procedure | + | |
| - | 2014-11-14 | + | |
| - | gcardone | + | |
| - | b5a2ead | + | |
| - | avoid map radial profile if new_ptles set | + | |
| - | 2014-11-13 | + | |
| - | gcardone | + | |
| - | edab616 | + | |
| - | increase buffer display in robem | + | |
| - | 2014-11-13 | + | |
| - | gcardone | + | |
| - | 2b5bad3 | + | |
| - | autopp6: make up particle parameters when splitting empty files | + | |
| - | 2014-11-13 | + | |
| - | gcardone | + | |
| - | 43065ff | + | |
| - | auto3dem: move the parameter updates outside of even/odd loops | + | |
| - | 2014-11-12 | + | |
| - | gcardone | + | |
| - | 41d7c5d | + | |
| - | auto3dem: parameter files need to be complete for gold standard | + | |
| - | 2014-11-12 | + | |
| - | gcardone | + | |
| - | efd1c92 | + | |
| - | ppft: added warning messages during initialization | + | |
| - | 2014-11-12 | + | |
| - | gcardone | + | |
| - | 9e52b92 | + | |
| - | fix error messages in get_info module | + | |
| - | 2014-11-10 | + | |
| - | gcardone | + | |
| - | 3707beb | + | |
| - | fix split and join of parameter files | + | |
| - | 2014-11-07 | + | |
| - | gcardone | + | |
| - | afe0100 | + | |
| - | implement gold standard procedure in auto3dem | + | |
| - | 2014-11-07 | + | |
| - | gcardone | + | |
| - | 24f7bda | + | |
| - | autopp: added option to split parameters into even and odd numbered particles | + | |
| - | 2014-10-29 | + | |
| - | gcardone | + | |
| - | 015c364 | + | |
| - | POR and PPFT: constraint shift values in output dat files | + | |
| - | 2014-10-27 | + | |
| - | gcardone | + | |
| - | af59ff3 | + | |
| - | autoppK: remove box size from first line of dat files | + | |
| - | 2014-10-27 | + | |
| - | gcardone | + | |
| - | 95b4693 | + | |
| - | improved logs and check controls in PPFT | + | |
| - | 2014-10-27 | + | |
| - | gcardone | + | |
| - | affc9fb | + | |
| - | robem: open stack images even if in different directory than dat file | + | |
| - | 2014-10-01 | + | |
| - | gcardone | + | |
| - | b1ed54e | + | |
| - | tiff2pif: fix interface and handle endianess | + | |
| - | 2014-09-26 | + | |
| - | gcardone | + | |
| - | 5b1c547 | + | |
| - | fixed bug when estimating mask radii and changed constant factor for outer radius | + | |
| - | Added option for not masking corners when generating/processing stacks | + | |
| - | 2014-09-02 | + | |
| - | gcardone | + | |
| - | a483f09 | + | |
| - | autopp j: remove box size info from first line | + | |
| - | 2014-04-16 | + | |
| - | gcardone | + | |
| - | 8d9e72e | + | |
| - | added installation script for mac osx | + | |
| - | 2014-07-28 | + | |
| - | gcardone | + | |
| - | f72b1be | + | |
| - | autopp 3 (ctffind): remove unused variable pave | + | |
| - | 2014-07-18 | + | |
| - | gcardone | + | |
| - | 028e99c | + | |
| - | autoppJ: remove box size from first line of dat files | + | |
| - | 2014-07-08 | + | |
| - | gcardone | + | |
| - | aacfb8f | + | |
| - | dm32pif: unsigned integer accepted | + | |
| - | 2014-07-08 | + | |
| - | gcardone | + | |
| - | b5940e3 | + | |
| - | fixed index bug in ppft for compare_mode 1 (not currently used) | + | |
| ==== auto3dem v4.04 ==== | ==== auto3dem v4.04 ==== | ||
| Line 444: | Line 437: | ||
| <WRAP center round box 60%> | <WRAP center round box 60%> | ||
| - | OLD: xbatch robem –pre infile [other options] | + | OLD: xbatch robem –pre infile [other options]\\ |
| NEW: robem –nogui –pre infile [other options] | NEW: robem –nogui –pre infile [other options] | ||
| </WRAP> | </WRAP> | ||
| - | * Fixed the feature that adds Gaussian noise to an image. This had been done incorrectly in previous versions as evidenced by the fact that adding Gaussian noise with mean=0 changed the mean intensity of the image. | + | * Fixed the feature that adds Gaussian noise to an image. This had been done incorrectly in previous versions as evidenced by the fact that adding Gaussian noise with mean=0 changed the mean intensity of the image. (This feature is found at Manipulate > Fix Values) |
| - | (This feature is found at Manipulate > Fix Values) | + | |
| * Fixed bug that caused robem to crash when clicking in drawing area of particle processing screen before particles had been loaded. | * Fixed bug that caused robem to crash when clicking in drawing area of particle processing screen before particles had been loaded. | ||
| * Fixed bug where display of radial projections would sometimes cause robem to crash. | * Fixed bug where display of radial projections would sometimes cause robem to crash. | ||