Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

osgar/logger.py - support gzipped logfiles #980

Closed
wants to merge 1 commit into from

Conversation

m3d
Copy link
Member

@m3d m3d commented Mar 2, 2024

Sometimes the content of OSGAR logs is wasteful, for example if you need to log raw sensor data and they are mostly zeros. One possibility is to gzip the stream, but an alternative (potentially faster for run-time) is to gzip OSGAR log file in some post-processing. I see now on robot Pat relatively large file and gzip helps a little bit there:

(osgar) robot@screwbot-ODYSSEY-X86J4125:~/git/osgar$ ls -lh *240302*
-rw-rw-r-- 1 robot robot 784M bře  2 15:38 fr07-followpath-240302_143722.log
-rw-rw-r-- 1 robot robot 677M bře  2 15:43 fr07-followpath-240302_144238.log
-rw-rw-r-- 1 robot robot 205M bře  2 15:46 fr07-followpath-240302_144603.log
-rw-rw-r-- 1 robot robot  52M bře  2 15:46 fr07-followpath-240302_144650.log
-rw-rw-r-- 1 robot robot 406M bře  2 15:49 fr07-followpath-240302_144850.log
-rw-rw-r-- 1 robot robot 373M bře  2 15:55 fr07-followpath-240302_145525.log
-rw-rw-r-- 1 robot robot 337M bře  2 15:58 fr07-followpath-240302_145817.log
-rw-rw-r-- 1 robot robot  63M bře  2 15:40 fr07-go-240302_144020.log
-rw-rw-r-- 1 robot robot 6,3M bře  2 15:41 fr07-go-240302_144126.log
-rw-rw-r-- 1 robot robot 107M bře  2 15:44 fr07-go-240302_144432.log

robot@screwbot-ODYSSEY-X86J4125:~/git/osgar$ ls -lh *240302*
-rw-rw-r-- 1 robot robot 540M bře  2 15:38 fr07-followpath-240302_143722.log.gz
-rw-rw-r-- 1 robot robot 469M bře  2 15:43 fr07-followpath-240302_144238.log.gz
-rw-rw-r-- 1 robot robot 136M bře  2 15:46 fr07-followpath-240302_144603.log.gz
-rw-rw-r-- 1 robot robot  31M bře  2 15:46 fr07-followpath-240302_144650.log.gz
-rw-rw-r-- 1 robot robot 281M bře  2 15:49 fr07-followpath-240302_144850.log.gz
-rw-rw-r-- 1 robot robot 255M bře  2 15:55 fr07-followpath-240302_145525.log.gz
-rw-rw-r-- 1 robot robot 227M bře  2 15:58 fr07-followpath-240302_145817.log.gz
-rw-rw-r-- 1 robot robot  42M bře  2 15:40 fr07-go-240302_144020.log.gz
-rw-rw-r-- 1 robot robot 3,9M bře  2 15:41 fr07-go-240302_144126.log.gz
-rw-rw-r-- 1 robot robot  71M bře  2 15:44 fr07-go-240302_144432.log.gz

@m3d m3d requested a review from tajgr March 2, 2024 16:26
@m3d
Copy link
Member Author

m3d commented Mar 2, 2024

p.s. well class LogIndexedReader is not supported and that's probably why I did not backported :( ... work in progress

@tajgr
Copy link
Collaborator

tajgr commented Mar 23, 2024

p.s. well class LogIndexedReader is not supported and that's probably why I did not backported :( ... work in progress

It is connected with lidarview. Add some support warning? What is current state?

@m3d
Copy link
Member Author

m3d commented Mar 24, 2024

well, I did not resolve this yet (other priorities, I will probably temporarily close it until I solve it). In the other project I use replay and draw option directly in modules so it does not matter that lidarview is not supported there ...

@m3d
Copy link
Member Author

m3d commented Mar 24, 2024

temporarily (?) paused, until lidarview is resolved

@m3d m3d closed this Mar 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants