stock777 Posted September 17, 2015 Report Share Posted September 17, 2015 Seeing this issue from time to time. Not sure if its rollover related (dont think so) . Getting spurious bars between 16:30 and 17:00 , but not seeing the data in the RAW feed. See attached image. http://forums.medvedtrader.com/index.php?/gallery/image/11-/ Quote Link to comment Share on other sites More sharing options...
Jerry Medved Posted September 17, 2015 Report Share Posted September 17, 2015 there was no image attached Quote Link to comment Share on other sites More sharing options...
stock777 Posted September 17, 2015 Author Report Share Posted September 17, 2015 You're just too fast, I posted and then fooled with getting the image uploaded. The 'gallery' here is a bit clumsy , would prefer to just be able to UL directly to the message, but doesn't seem to be a way. Quote Link to comment Share on other sites More sharing options...
Jerry Medved Posted September 17, 2015 Report Share Posted September 17, 2015 uploads are disabled right now. something must show on raw data. turn filtering off. Also, what datafeed? and do you only have one? Quote Link to comment Share on other sites More sharing options...
stock777 Posted September 18, 2015 Author Report Share Posted September 18, 2015 Filtering is already off. IB datafeed. The Ameritrade feed I also use doesn't have futures. All I see at that time is about 10k worth of volume at 16:44-45, then starts up again at 16:30 with normal volume. Thats' why I think there's an issue, the chart is showing something else as you can see., It's a big file, but could always send you the data to look at. Quote Link to comment Share on other sites More sharing options...
Jerry Medved Posted September 18, 2015 Report Share Posted September 18, 2015 Yes, export with data. then you can post it via https://www.wetransfer.com/ Quote Link to comment Share on other sites More sharing options...
stock777 Posted September 18, 2015 Author Report Share Posted September 18, 2015 While you have all the data, check into cpu usage. Today a real cpu hog, using 50%!! and 1.7 GIG of ram This is at 10:45, busy market but not wildly so. Quote Link to comment Share on other sites More sharing options...
Jerry Medved Posted September 18, 2015 Report Share Posted September 18, 2015 I ran with your settings. Didn't see anything particularly unusual. Didn't see any high CPU usage except in the first minute of running (that is normal). Kind of depends on the that you have. We did change some stuff in the data cleanup in MT in the last build so that should help, but not immediately. There are a few things you can do to help that. I assume based on the stuff you sent me that you don’t need to have 60 days of data. And certainly don’t need more than a few days of tick data.I think the most that you need is maybe 20. So • Go to SETTINGS / CHARTS / GENERAL screen. • Change the “Max # of days of intraday data” value to a 20. • decrease the “Compress Tick data to OHLC beyond X Days” setting to 3 (unless you need more for the volume/tick charts) • Restart MT and wait at least 2 minutes (cleanup of expired data doesn’t start till a minute after startup) • Then go to SETTINGS / CHARTS / GENERAL screen again and check the “Consolidate on next app start”, then restart again Having less days of data, and having it consolidated to OHLC vs TICK data (that comes in from Level I quotes) will significantly reduce memory usage. Please let me know if that helps. BTW, the multiple restarts above is just in order to speed up the process. Otherwise, MT will do it, but at it’s own pace. Quote Link to comment Share on other sites More sharing options...
stock777 Posted September 18, 2015 Author Report Share Posted September 18, 2015 Will try what I can, but already have consolidate set low (2). Quote Link to comment Share on other sites More sharing options...
stock777 Posted September 18, 2015 Author Report Share Posted September 18, 2015 remembered what i did to fix this. when the futures rolled over apparently the setting didnt stick based on root, and I forgot Id changed to : , globex REG hours, extended always, to get a clean chart plain globex causes the issue. Quote Link to comment Share on other sites More sharing options...
stock777 Posted September 18, 2015 Author Report Share Posted September 18, 2015 I see that the sdata.bin had gotten to 900 meg. I reduced days to 30 and that brought if down to <500 meg, as expected There's an issue with that though. For stocks, I really dont care, but I'd like to save at least the consolidated bars for FUTURES symbols for at least 90 days. I assume I'll lose that intraday data after 30 days on the ES , NQ etc with the setting at 30 . Is there some way to deal with this? Quote Link to comment Share on other sites More sharing options...
Jerry Medved Posted September 18, 2015 Report Share Posted September 18, 2015 Yes, MT will clear out all data beyond the specified max. Wouldn't 90 days (more than 4 months) be more for Historical Charts? You could change the # and then backfill with IQFeed. Quote Link to comment Share on other sites More sharing options...
stock777 Posted September 19, 2015 Author Report Share Posted September 19, 2015 Basically, I want the volume chart for futures through expiration. I don't subscribe to IQfeed, I use IB's data. So I think you'd have to do something where certain symbols could be retained for a longer period of time. Otherwise would have to keep data on 100+ stocks for 60 days just so ES & NQ can be preserved for that period. Quote Link to comment Share on other sites More sharing options...
Jerry Medved Posted September 19, 2015 Report Share Posted September 19, 2015 don't have a way to do that. Even so, the new version will keep less data. Previously, it was keeping 120 Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.