Adam Nemet 81032e2009 [opt-viewer] Reduce memory consumption by another 20-25% ... The Args field of the remark which consists of a list of mappings in YAML is translated into a list of (small) dicts on Python. An empty dict is 280 bytes on my system so we can save memory by using a tuple of tuples instead. Making a tuple of tuples rather than a list of tuples allows Args to be shared with the key of the remark. This is actually an even greater saving. (Keys are alive throughout the entire run in all_remarks.) Here are a few opt-stats runs with different input sizes while measuring heap usage with heapy. Avg remark size is simply estimated as heap-size / # of remarks: | # of files | 60 | 114 | 308 | 605 | 1370 | | # of remarks | 20K | 37K | 146K | 180K | 640K | | total file size (MB) | 22 | 51 | 219 | 202 | 1034 | |------------------------+------+------+------+------+------| | Avg remark size before | 4339 | 4792 | 4761 | 4096 | 4607 | | Avg remark size after | 3446 | 3641 | 3567 | 3146 | 3347 | | Rate | 0.79 | 0.76 | 0.75 | 0.77 | 0.73 | Differential Revision: https://reviews.llvm.org/D35611 llvm-svn: 308538		2017-07-19 22:04:59 +00:00
..
CMakeLists.txt
opt-diff.py	[opt-viewer] Reduce memory consumption by another 20-25%	2017-07-19 22:04:59 +00:00
opt-stats.py	[opt-viewer] Print allocated memory per remark in opt-stats.py	2017-07-19 22:04:58 +00:00
opt-viewer.py	[opt-viewer] Reduce memory consumption by another 20-25%	2017-07-19 22:04:59 +00:00
optpmap.py	[opt-viewer] Flush stdout after progress update	2017-07-14 04:54:26 +00:00
optrecord.py	[opt-viewer] Reduce memory consumption by another 20-25%	2017-07-19 22:04:59 +00:00
style.css