+ i4 !Rt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RI t ^RI t ^RI t ^RI H uHt^RIHtHt^RIHtHt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIt]P>!R4^RI H!t"^RI#H$t$^RI%t%Rt&^R I)H*t*Rt+^RI,t,Rt-^RI.t.Rt/^RI0t1Rt2^RI3t3Rt4^R I5H6t6H7t7^RI8H9t9H:t:^RI;Ht>^RI?H@t@]P!4tB]C!^]D!]B^44tE]EtF]E]F,tG]PPRR4tJ]PPRR4tK]PPRR4tL]PPRR4tM]PPRR4tNRtORtPRtQRtR^tSR tTR!tUR"tV^tWERtXERtYERtZERt[ERt\Rt]R%t^^Zt_R&R'lt`R(R)ltaR*tbR+tcR,td^2te^dtfR-tgR.thR/tiR0tjR1tkR2tlR3tmR3tnR1toR4tp^tq^trR5tsR6ttR$tuR7tv]PPR8R4tw]PPR9R4txR:ty]PPR;R4tzRt~R?tR@t.EROt.EROtRAtRBtRCtRDtREtRtRtRFtRGtRHtRIt^2tRJt^NER?NER@NERANERBNERCNERDNERENERFNERGNERHNERINERJNERKNERLNERMNERNNERONERPNERQNERRNERSNERTNERUNERVNERWNERXNERYNERZNER[NER\NER]NER^NER_NER`NERaNERbNERcNERdNEReNERfNERgNERhNERiNERjNERkNERlNERmNERnNERoNERpNERqNERrNERsNERtNERuNERvNERwNERxNERyNERzNER{NER|NER}NER~NERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNt]!]EP]44ER,t0ERmt.EROtERERltERt]!]E]F4tERERltERERltERERlt!ERER4t!ERER4t!ERER4t!ERER4t!ERER4t.ERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNERNt]!]4tERERERllt!ERER4t!ERER4tERERltERERlt!ERER 4t!ER ER 4t!ER ER ]4tERtERERERllt!ERER4t!ERER4t!ERER4t!ERER4tERERltERERltERERERlltERERER lltER!ER"ltER#ER$ltERER%ER&lltER'ER(ltER)ER*ltER+ER,lt!ER-ER.4tER/ER0ltER1ER2lt^ltER?ER@lt!ERAERB4Et.Et]EPr!4EtERCERDlEtEREEt!ERFERG4EtE]!4Et]C!^]D!]B^44EsE]!]BERH7Et!ERIERJ4Et ]ERK8XEd]4'd]3EP!4](!ERL4^REI Et E] EP!ERMERNE] EPEROERP7EtE]EP!ERQERRRERSERT7E]EP!ERUER3ERVERWERX7E]EP!ERYERZ.EROER]ER^7E]EP!ER_E]RER`ERaERb7E]EP!ERcE]RERdEReERb7E]EP'4EtE]EP*EP-ERf4Uu0uF"qEP/4EP14kK$ upEtE]], EtE]'d*](!ERgE] 24](!ERhE]!]4 24E]!^4^REIEtE]EP>P]E]EP>ERK,4Et E]EPBeE]!E]EPBERi,4E] n](!ERjE]EPBERk ERlE] EPERf ERmE]!E] EPR#,4ERf ERnE]!E] EPERo,4ERf ERp2 4MRE] n](!ERq4E]EPDe7]C!^E]EPD4E] n](!ERrE] EP ERs24MRE] n](!ERt4E]EPF'dB](!ERu4](!ERvERwEPIE]!E]44 24](!ERx4](!ERy4M#]J'g](!ERz4](!ER{4E]!^4E]EPF'gt](!ER|E]EPJEPM4 24E]EPJER[8Xd ](!ER}4M'E]EPJER\8Xd ](!ER~4M ](!ER4](!4E] !E]EPFE]E]EPJER7EPO4R#R# ]'dRt&](!R4](!R4ELi;i ]'d!R R 4t*Rt+ELi;i ]'d Rt,Rt-ELi;i ]'dRt/ELi;i ]'dRt1Rt2](!R 4ELi;i ]'d Rt3Rt4EL#i;iuupi(u ML Stock Trading System v9 — Alpaca WebSocket + Finnhub Multi-Source Edition ============================================================================= KEY IMPROVEMENTS OVER v6: BUG FIXES: - DB freeze fixed: dedup cache (5s buckets) replaces UNIQUE constraint so valid quotes are never silently dropped. - Training stall fixed: first train triggers as soon as 5+ symbols have enough data, not gated behind a 100-cycle counter. - Clone agents each get their own independent StockModel instance. - Quote polling is strict round-robin (not random weighted). - MetaLearner trains unconditionally at every retrain cycle. - Agent→agent knowledge sharing still requires profit (donor must be +ve). - Clone min_conf hard-capped at 0.62 after param nudging. DATA SOURCES: - Alpaca WebSocket (FREE): minute bars for ALL IEX symbols (~8,000-9,000). Subscribed with wildcard "*" — zero polling calls used. Pushes a bar every 60s per symbol automatically. No rate limit, no daily cap, 0 REST calls consumed. - Finnhub REST (FREE, 58/min): live quotes for your active 300-stock universe via strict round-robin. Now supplemental to Alpaca — used for sub-minute price freshness on symbols agents are holding or watching. - Alpha Vantage (FREE, 25/day): 5-min intraday bars, supplemental. - Polygon (FREE, 5/min): prev-day minute bars at market open. VELOCITY FEATURE (NEW): - Every bar arrival from Alpaca records the time since the last bar. - price_velocity = (close_now - close_prev) / seconds_elapsed - Added as "price_velocity" to FEATURE_COLS so models learn from it. DATA COVERAGE: - Alpaca free IEX wildcard: ~8,000-9,000 unique symbols per minute. - Finnhub 58/min round-robin: your 300-stock universe covered every ~5 min. - Combined: all 300 core stocks get sub-minute Alpaca bars PLUS Finnhub confirmation quotes, giving the densest free live dataset possible. BEST STOCK RANGE FOR PROFIT (see STOCK_UNIVERSE_PRIMARY comments): Sweet spot is $5-$200 mid-cap liquid stocks with tight spreads. Mega-caps (AAPL, MSFT) are too efficient — thin margins for ML edge. Penny stocks (<$5) are too volatile and often illiquid on IEX. Best performers empirically: $20-$80 range, daily volume >500k, sectors: Tech, Financials, Healthcare, Energy. ETFs excluded from trading. THOUGHT PROCESS / VISIBILITY: - All BUY/SELL decisions logged with full reasoning chain: own_conf, meta_conf, effective_conf, threshold, decision. - Hourly report includes WIN/LOSS summary: gross profit, gross loss, total P&L, win streaks, per-agent breakdown. - TRADE_LOG.csv written in real-time for external Excel/pandas analysis. - MetaLearner logs which symbols it's boosting and why. TRAINING: - Each agent has slightly different GBM hyperparams so models diverge. - Training is ONLINE: only live quotes collected during market hours. - Retrain every 15 min at :00/:15/:30/:45 during market hours. - Agents scale to 3x CPU cores, capped at 48 total. Install: pip install finnhub-python scikit-learn numpy pandas joblib pytz matplotlib requests websocket-client Usage: export FINNHUB_API_KEY=your_key_here export ALPACA_API_KEY=your_alpaca_key # free at alpaca.markets export ALPACA_SECRET_KEY=your_alpaca_secret export ALPHA_VANTAGE_KEY=your_key_here # optional export POLYGON_KEY=your_key_here # optional python StockTrading_v7.py Ndatetime timedelta)deque defaultdictAggTFzK[WARNING] websocket-client not installed. Run: pip install websocket-clientuB Alpaca stream disabled — falling back to Finnhub only.)SentimentIntensityAnalyzerc&a]tRt^itoRtRtVtR#)rc RR/#)compound)selftexts&&StockTrading.pypolarity_scores*SentimentIntensityAnalyzer.polarity_scoresjs $ $r N)__name__ __module__ __qualname____firstlineno__r__static_attributes____classdictcell__ __classdict__s@rrris % %rrz;[WARNING] lightgbm not installed. Run: pip install lightgbm)ThreadPoolExecutor as_completed)GradientBoostingClassifierGradientBoostingRegressor)StandardScaler)train_test_split)accuracy_scoreFINNHUB_API_KEY(d6c79h9r01qsiik11kt0d6c79h9r01qsiik11ktgALPACA_API_KEYPKLNUNIF76AZQBULGIKCRYLKQ2ALPACA_SECRET_KEY,FNqvcb93Vb7C5U1t6vuafNkjR61zhxqkPq7as8qYnSm8ALPHA_VANTAGE_KEYCKDWGTR0PKRWHEBU POLYGON_KEYg@@皙?Q?333333?皙?皙???皙?zdata/db/trading_datac$V^8dQhR\/#returnstr)formats"r __annotate__r<sFFFrc^\ R\P!4PR4 R2#)z(Return the DB filename for today's date._%Y%m%d.db)DB_FILE_PREFIXrnowstrftimer rr_today_db_pathrDs( Qx||~66x@A EErc$V^8dQhR\/#r6list)r;s"rr<r<strcd^RIp\P!4\\R7, P R4p.p\ VP\ R244FpVP\ R2R4PRR4pWA8dVPV4KERFLp\PPW5,4'gK0\P!W5,4KN K \4pWb9dVPV4V# \dKi;i) z]Return all daily DB paths sorted oldest-first. Auto-deletes files older than DB_HISTORY_DAYS.Ndaysr? _????????.dbr>r,r@r,-wal-shm)globrrBrDB_HISTORY_DAYSrCsortedrAreplaceappendospathexistsremove ExceptionrD)rOcutoffpathspdate_strsuffixtodays r _all_db_pathsr_sllnyo>> H H RF E DII 0 => ?99/q126>>ubI   LLO 2Fww~~aj11 !*-3 @  E  U L   s'-D  D  D/.D/backupzfeatures/dailyzfeatures/weeklyi ,zdata/db/sentiment_data.dbQi?@?REDDIT_CLIENT_IDREDDIT_CLIENT_SECRETzStockTradingBot/9.0STOCKTWITS_TOKENiXzphttps://efts.sec.gov/LATEST/search-index?q=%22{symbol}%22&dateRange=custom&startdt={start}&enddt={end}&forms=8-Kzfhttps://efts.sec.gov/LATEST/search-index?q=%22{symbol}%22&forms=8-K&hits.hits._source=period_of_reportzMhttps://financialmodelingprep.com/api/v4/senate-disclosure?page=0&apikey=demozMhttps://news.google.com/rss/search?q={symbol}+stock&hl=en-US&gl=US&ceid=US:enlogs/trading_data.loglogs/hourly_report.loglogs/TRADE_LOG.csvlogs/train_checkpoint.jsonlogs/train_done.jsonzlogs/debug/debug.logmodelslogs/agent_state.jsonchartsgQ?zAmerica/New_YorkAmerica/Chicagoz'wss://stream.data.alpaca.markets/v2/iexdatalogsz logs/debugopsexist_okzdata/dbOMP_NUM_THREADS4OPENBLAS_NUM_THREADSMKL_NUM_THREADSc Na4\^4\PR4^RIp^dp\P !\ 4PR4p\P!4p^p^RI pVP\ R24FVp\P!V^R7;_uu_4pVPR4RRR4\PRV 24KX \$P&!\$P(P+\,R 4R R 7\$P&!\$P(P+\,R 4R R 7\$P&!\$P(P+\,R R4R R 7\$P(P+\,R4\$P(P+\,R4\$P(P+\,R4\$P(P+\,R4\$P(P+\,R4\$P(P+\,R4\$P(P+\,R4\$P(P+\,R4\$P(P+\,R4. p V FXp \$P(P/V 4'gK*\$P0!V 4\P3RV 24KZ RRRRRRRR \4\6\8\:3 EFPp \$P(P/V 4'gK+\P!4p \$P(P+\,\$P(P=V 44p \$P&!V R R 7VP?V \$P(P+\,V 44\$P(PAV 4pWN, p\C\P!4V , R!,4pVR"8gEK*\P#R#V R VR$, R%V R&24EKS VP\ R24EFypRPEFnpVV,p\$P(P/V4'gK4\$P(PAV4pVR'8XdDWR$,R$,8d0\P#R(V R VR$,R$, R)V R*24K\P!4p VP?V\$P(P+\,\$P(PEV444WN, p\C\P!4V , R!,4pVR!8gEKA\P#R+V R VR$,R$, R,V R&24EKq EK| \$P(P/R-4'dp\$P&!\$P(P+\,R 4R R 7VP?R-\$P(P+\,R R-44\$P(P+\,R.4p\$P&!VR R 7\$PF!\H4FUpVP?\$P(P+\HV4\$P(P+VV44KW /p\$PF!V4F<pVPKR/4^,pVPMV.4POV4K> VPQ4FWwpp\SVR R07pVR1,F7p\$P0!\$P(P+VV44K9 KY \$P(P+\,R34p\$P&!VR R 7\P!4RQ, o4\$P(PU\V4'dk\X;QJd7V43R4l\$PF!\V44F 'gK R M. R5M*!V43R4l\$PF!\V444MR5pV'd\$PF!\V4FUpVP?\$P(P+\VV4\$P(P+VV44KW \P3R64M\PR74V^,p\$P(P+R R4p\$P(PUV4'd\P!4RR, p\$PF!V4FpVP[R84'gKVP]R94'gK5\$P(P+VV4p \$P(P_V 4V8gK{\$P0!V 4K ^RI p"\P!4RS, p#\$P(P+\,R;4\$P(P+\,R4.p$T$Fp%T"PT%4Fxp&\$P(P_T&4T#8gK)RPFIpT&T,p'\$P(P/T'4'gK3\$P0!T'4KK Kz K \P!4RT, p)\P!4RU, p*\`T)R=3\bT*R>33Fwp+pp,\$P(PUT+4'gK.\$PF!T+4Fzp-\$P(P+T+T-4p \$P(P_T 4T8gKI\$P0!T 4\P3R?T, R@T- 24K| K RVFpX"P\ RT 24Fgp/T/R\eT4)p0\$P(P/T04'dK9\$P0!T/4\P3RBT/ 24Ki K \C\P!4T, R!,4p2\fP3RD\, RET RF24\P3RGT RHTR$,R$, RIT2 R&24T2RJ8d\P#RKT2 RL24R#R# +'giE Ll;i \ d(p\P#RT R T 24Rp?E KRp?ii;i \ d$p\P#R2T 24Rp?ELWRp?ii;i \ d$p!\P#R:T! 24Rp!?!ELRp!?!ii;i \ d$p(\P#Rp3\fP#RMT3 24\PiRNT3 2R RO7Rp3?3R#Rp3?3ii;i)Wad Local backup of important files to backup/ WAL FIX: The trading_data DB WAL file grew to 2.9 GB. Copying 2.9 GB in a background thread saturated disk I/O for 20-30 seconds, delaying all threads including the WebSocket ping thread. Now: WAL files > WAL_BACKUP_CAP_MB are skipped -- they will be checkpointed at the next PRAGMA wal_checkpoint call anyway. local_backup_startN %Y%m%d_%H%M%SrKtimeoutPRAGMA wal_checkpoint(PASSIVE)zBACKUP_WAL_CHECKPOINT | zBACKUP_WAL_CKPT_FAIL |  | ruTrxrvdebugzagent_state.jsonz debug.logzhourly_report.logz TRADE_LOG.csvztrading_data.logzsentiment_data.dbtrading_data.dbztrading_data.db-shmztrading_data.db-walzBACKUP_GHOST_CLEAN | removed rrrmrnrllogs/human_report.txtlogs/claude_handoff.jsonlogs/bot_dashboard.htmlrpzBACKUP_SLOW_FILE | zKB | msrMzBACKUP_WAL_SKIPPED | MB > z1MB cap -- too large to copy safely during tradingzBACKUP_SLOW_DB | zMB | trading.logrsr>)reverse: NNzCHART_PRUNE_ERR | saved_modelsc3<"TFbpVPR4'gK\PP\PP \ V44S8xKd R#5i).pklN)endswithrTrUgetmtimejoinMODEL_SAVE_DIR).0f _model_cutoffs& r run_backup..sJ /zz&! NBGG  RWW\\.!< = M/s A-A A-Fz)BACKUP_MODELS | copied (recently trained)z,BACKUP_MODELS | skipped (no recent training)debug_.logzDEBUG_LOG_CLEANUP_ERR | ztrading_data_????????.dbzBACKUP_DB_CLEANUP_ERR | DAILY_FEAT WEEKLY_FEATzFEAT_RETENTION_CLEAN | z | removed zFEAT_RETENTION_ERR | zORPHAN_SIDECAR_CLEAN | removed zORPHAN_SIDECAR_ERR | zBackup complete -> z/ (z CST)zBACKUP_COMPLETE | ts=z | bytes=z MB | elapsed=izBACKUP_SLOW_TOTAL | z3ms -- disk I/O pressure may delay WebSocket thread!zBackup error: zBACKUP_ERROR | exc_inforLi0*i'i: iui)rNrM)5 _set_nice_resource_guardyield_p4shutilrrB DISPLAY_TZrCtimerOrAsqlite3connectexecute debug_loggerrrXwarningrTmakedirsrUr BACKUP_DIRrVrWinfoSENTIMENT_DB_FILE DATA_LOG_FILEREPORT_LOG_FILEDEBUG_LOG_FILEdirnamecopy2getsizeintbasenamelistdir CHARTS_DIRsplit setdefaultrSitemsrQisdirrany startswithrrFEATURES_DAILY_DIRFEATURES_WEEKLY_DIRlenloggererror)5rWAL_BACKUP_CAP_MBtst_start bytes_copied_glob_db_c_e _ghost_files_gffnamet0dest_dirszelapsed_sfx_src backup_chartsr_chart_by_type_cf_ctype_cfiles_sorted _old_chart_ce3 backup_models_any_model_recent _debug_dir_cutoff_f_fp_ce_g2 _db_cutoff _db_patterns_pat_old_p_ce2_feat_daily_cutoff_feat_weekly_cutoff_fdir_label_ff_fe_side_main_oetotal_msers5 @r run_backupr]s# bM12CA \\* % . . ?))+  :: 0 =>C M__S!44JJ?@5""%=cU#CD ? BGGLLV4tD BGGLLV4tD BGGLLVW=M GGLL%7 8 GGLL[ 1 GGLL%8 9 GGLL_ 5 GGLL%7 8 GGLL%8 9 GGLL%6 7 GGLL%: ; GGLL%: ;   Cww~~c"" #!!$A#"GH $&> &= #&@ %&<  ?N  Eww~~e$$YY[77<< BGGOOE4JK Ht4 UBGGLLU$CDWW__U+" tyy{R/478S= ((+>ugST RWX_W``b)cd% *:: 0 =>C,Tzww~~d++WW__T*6>bt+Cd+J&J ((/vSt8T>*%0A/BCBC YY[ T277<< BGG ((+>- ( ( KK Z84 H LL Z(W X Z:  MD1J'A LLj!4bggll=RS6T U( >#%Nzz-03*))&"5< * *  C ZZ/ CCC ZZ/  16  ZZ/ RWW\\.!\]0   I J   M N A L Cfg6Jww}}Z(())+ 2**Z0B}}X..2;;v3F3F ggll:r:77++C07:IIcN 1 D y0J Z)CD Z):;L%HHTNDww''- :$8D!%B!ww~~b11 " " %9+% @"&))+ ": "&))+"> #&8<H$&9=I+&www}}U++::e,C'',,uc2Cww'',w6 #$)),CF8;WZV[*\] - + @( XX(8 TF&KLE!+CI:.E77>>%00 %($)),KE7*ST M) g-56 )*T"UCD#B4(!4'-.mH:R I  d?  &xj1@A  g544 M$$'>se3rd%KLL Ml >  #5dV!< = = >> C  #;C5!A B B C& D  #;D6!B C C D( @  #8!> ? ? @ @  #8!> ? ? @ As+,_QC04@@AsA} x2)x; x2H}7A6}2C9}1F};A}D}6Cy'9B },}49}.B'}AzA z)zAzz#B"{ 0{ ?"{ "C{:99{:3A|+ 6|+B} x/ ) x22 y$=y}y$$}' z2z }z} {#{;}{} {7{2,}2{77}: |(|#}#|((}+ }6}}}} ~$'2~~$cRa]tRtRtoRt]P !R4tRRltRt Vt R#) _CSTFormatteri<z?Log formatter that outputs timestamps in CST (America/Chicago).rtNc\P!VPVPR7pTP T;'gR4#)tz%Y-%m-%d %H:%M:%S)r fromtimestampcreated_CSTrC)rrecorddatefmtdts&&& r formatTime_CSTFormatter.formatTime@s4  # #FNNtyy A{{799&9::rr N) rrrr__doc__pytztimezonerrrrrs@rrr<s!I ==* +D;;rrc.a]tRtRtoRtRRltRtVtR#)_CSTFormatterMsiDz.CST formatter with milliseconds for debug.log.Nc\P!VPVPR7pVP R4pV R\ VP 4R 2#)rr.03d)rrrrrCrmsecs)rrrrbases&&& rr_CSTFormatterMs.formatTimeFsH  # #FNNtyy A{{./qV\\*3/00rr r )rrrrr rrrrs@rrrDs811rrz'%(asctime)s [%(levelname)s] %(message)sr)rz8%(asctime)s [%(levelname)s] [%(threadName)s] %(message)s)levelhandlersreportrr>rrw)modec\PP\4'gO\ \RRR7;_uu_4p\ P !V4pVP.RO4RRR4R#R# +'giR#;i)rr,newlineN) timestampagenttypesymbolshares entry_price exit_pricepnlpnl_pct predicted_pctdisc_ppreason held_secsown_conf meta_confeff_conf)rTrUrVTRADE_LOG_FILEopencsvwriterwriterow)rrs r_init_trade_logr2{s[ 77>>. ) ) .#r 2 2a 1 A JJ 3 2 * 2 2 2s *A:: B c$V^8dQhR\/#)r7rowdict)r;s"rr<r<sOOOrc\;_uu_4\\RRR7;_uu_4p\P!V4pVP VP RR4VP RR4VP RR4VP RR4VP R^4R VP R ^4R VP R ^4R VP R ^4R VP R^4R VP R^4R VP R^4R VP RR4VP R^4VP R^4R VP R^4R VP R^4R .4RRR4RRR4R# +'giL;i +'giR#;i \d+p\PRT R\ 24Rp?R#Rp?ii;i)ar,rrrrSELLr r!.4fentryexitr$z+.4fr%+.2fr&r'.3fr(r)r*r+r,NzTRADE_LOG_WRITE_ERR | z | file=) _trade_log_lockr.r-r/r0r1getrXrr)r4rr_wtles& rwrite_trade_logrBsO _nc266!JJqM GGK+0CGGF6*0Dwwx*3/wwwq)#.CGGF14Ec3JwwuQ'-3779Q3G2Mwwq1$7wwy+C0GGHR( A0Fwwz!,S1ww{1-c2wwz!,S1  7_66__ O -eWH^ףp= ?皙?333333?Ti^r1)rRandomrange_BASE_PROFILESrrSrandintroundrrseedrSTOP_LOSS_RANGETAKE_PROFIT_RANGEminMIN_CONF_RANGEMAX_POS_PCT_RANGE)n_basen_clonesrngconfigsir[rs&& rgenerate_agent_configsrs -- CG 6] 1s>22 3 ! ! ! ! !  !   C 5 ckk$&=q A  Aq 1  8_6z" q3w &fa!u = _(= Q Q ->(? TBS T GD1A,B$T^$TVZ [ %7 8299;L;LSRU;V V  A/@ A %5 6   C 5 ckk$&=q A  Aq 1   Nrc$V^8dQhR\/#r6bool)r;s"rr<r<%s###rc\P!\4pVP4^8dR#VP ^ ^^^R7pVP ^^^^R7pYu;8*;'dV8#u#)Fhourminutesecond microsecond)rrB MARKET_TZweekdayrR)rBopen_tclose_ts ris_market_openr%sd ,,y !C {{}kkq"QAkFFkkr!QAkFG  " "7 "" ""rc$V^8dQhR\/#r6r)r;s"rr<r<-s''E'rc\P!\4pVP^ ^^^R7pW8dV\ ^R7, pVP 4^8dV\ ^R7, pK*W, P 4#) rrI)rrBrrRrr total_seconds)rBnxts rseconds_until_openr-sh ,,y !C ++1Rq+ AC z ya   ++-1  ya   I $ $ &&rc$V^8dQhR\/#r6r)r;s"rr<r<6s::%:rc\P!\4pVP^^^^R7p\ RW, P 4R, 4#)rr N@)rrBrrRmaxr)rBcloses rmarket_minutes_remainingr6sC ,,y !C KKR!K CE sU[//1D8 99rca]tRtRtoV3RlRltRtRtRRltV3RlRltV3R lR lt V3R lR lt RR lt RV3RlRllt V3RlRlt RtVtR#)Databasei?c <V^8dQhRS[/#)r7rUr9)r;rs"rr<Database.__annotate__@sSrcWn\P!4Vn\P!4VnVP 4/VnR#r )_path threadinglocal_localLock_lock _init_schema_deduprrUs&&r__init__Database.__init__@s6 oo' nn&   rc,\VPR4'dVPPf\P!VP RR7pVP R4VP R4VP R4VP R4VP R4VP R4VP R4VP R 4VP R4WPnVPP#) connFcheck_same_threadPRAGMA journal_mode=WALPRAGMA synchronous=NORMALPRAGMA cache_size=-32768PRAGMA mmap_size=268435456PRAGMA temp_store=MEMORYPRAGMA busy_timeout=5000PRAGMA cache_size=-32000)hasattrrrrrrrrrs& r_connDatabase._connGst{{F++t{{/?/?/G??4::GD LL2 3 LL4 5 LL3 4 LL5 6 LL3 4 LL3 4 LL4 5 LL3 4 LL3 4#KK {{rcH\P!VP4;_uu_4pVPR4VPR4VPR4VPR4VPR4VPR4VPR4VPR4VPR4VPR4VPR4VPR 4VP 4R R R 4R # +'giR #;i) rrrrrrraH CREATE TABLE IF NOT EXISTS quotes ( id INTEGER PRIMARY KEY AUTOINCREMENT, symbol TEXT NOT NULL, ts INTEGER NOT NULL, ts_micro INTEGER NOT NULL DEFAULT 0, price REAL NOT NULL, open REAL, high REAL, low REAL, prev_close REAL, volume REAL, source TEXT DEFAULT 'finnhub' )z:CREATE INDEX IF NOT EXISTS idx_sym_ts ON quotes(symbol,ts)a CREATE TABLE IF NOT EXISTS accuracy_log ( id INTEGER PRIMARY KEY AUTOINCREMENT, ts INTEGER NOT NULL, agent TEXT NOT NULL, discrepancy REAL, profit_rate REAL, trades INTEGER, gross_profit REAL DEFAULT 0, gross_loss REAL DEFAULT 0 )N)rrrrcommitrs& rrDatabase._init_schema\s __TZZ ( (D LL2 3 LL4 5 LL3 4 LL5 6 LL3 4 LL3 4 LL4 5 LL3 4 LL3 4 LL   LLU V LL   KKMI) ( ( (s CD D! c W^,3p VP;_uu_4WP9d RRR4R#RVPV &\VP4R8dA\VPP 44R,p V Fp VPV K VP 4p V P RW\\P!4R,4R,W4WVWxV 3 4V P4RRR4R# \d&p\PRT RT 24Rp?L5Rp?ii;i +'giR#;i) rNTiP:Ni'NzoINSERT INTO quotes(symbol,ts,ts_micro,price,open,high,low,prev_close,volume,source) VALUES(?,?,?,?,?,?,?,?,?,?)@BzDB insert error : ) rrrrGkeysrrrrrrXrr)rr rpriceopen_highlow prev_closevolumesourcebucketoldestkrrs&&&&&&&&&& rinsertDatabase.inserts'" ZZZ$Z#'DKK 4;;&(dkk..01':A A  ?zz| 3TYY[9%> ?#ZZs6EA)E%A"D ED<7E<EE E c&<V^8dQhRS[RS[/#)r7rowsr8)rGr)r;rs"rr<rsrcV'g^#^pVP;_uu_4VP4pVFpV^,V^,reWV^,3pWpP9dK0RVPV&TPRV^,V^,^V^,V^,V^,V^,V^,V^,\ V4^8d V^,MR3 4V^, pK VP 4RRR4V# \ d#p\PRT 24Rp?L2Rp?ii;i +'giT#;i)TzyINSERT OR IGNORE INTO quotes(symbol,ts,ts_micro,price,open,high,low,prev_close,volume,source) VALUES(?,?,?,?,?,?,?,?,?,?)externalzDB bulk insert error: N) rrrrrrrXrr) rr nrrsymrrrs && r bulk_insertDatabase.bulk_inserts  ZZZ ;zz|AdAaD!7^F, *.DKK'LL71qtQ!adAaD!A$!ad!$Q!1= FA !& ; 5aS9:: ;#Z&s/D8CD D5D0+D80D55D88 E c:<V^8dQhRS[RS[P/#r7r r8r:pd DataFrame)r;rs"rr<rs " " " "rcVP4p\P!RW!3R7pV# \d\P!4u#i;i)zZSELECT ts,price,open,high,low,prev_close,volume FROM quotes WHERE symbol=? ORDER BY ts ASCparamsrrread_sql_queryrXr)rr rdfs&& r get_seriesDatabase.get_seriessN ":: ! "s*- AAc <V^8dQhRS[/#r6r5)r;rs"rr<rsDrcVP4pVPR4P4pVUu/uFq3^,V^,bK up#uupi \d/u#i;i)z3SELECT symbol, COUNT(*) FROM quotes GROUP BY symbol)rrfetchallrX)rrr rs& r row_countsDatabase.row_countsse :: ! "s), AAc <V^8dQhRS[/#r6r)r;rs"rr<rsrc\PPVP4R, # \dR#i;i)ir )rTrUrrrXrs&rsize_mbDatabase.size_mbs5 77??4::.: :  s/2 AA)rrrrN)finnhub)r r )d)rrrrrrrrrrr#r+r0r5rrrs@rrr?sV *%N?,2 " " 9 " "rrcna]tRtRtoV3RlRltRtV3RlRltV3RlRltV3R lR ltR t Vt R #) FinnhubClientic <V^8dQhRS[/#r7api_keyr9)r;rs"rr<FinnhubClient.__annotate__s'''rc\P!VR7Vn\4Vn\ P !4VnR#))r=N)r7Clientclientr_timesrrrrr=s&&rrFinnhubClient.__init__s)nnW5 g nn& rcXVP;_uu_4\P!4pVP'd;WP^,, R8dVPP4KL\ VP4\ 8d:VPP \P!44RRR4R#RWP^,, , pRRR4X^8gK\P!V4EK +'giL2;iTrNgN@)rrrBpopleftrFH_CALLS_PER_MINrSsleeprrBwaits& r _throttleFinnhubClient._throttlesiikkkkcKKN&:T&AKK'')t{{#&66KK&&tyy{3 s[[^34ax 4 s'DBD D D) c <V^8dQhRS[/#r6r)r;rs"rr<r>sBB3Brca\P!4oVP;_uu_4\V3RlVP44uuRRR4# +'giR#;i)c3H<"TFpSV, R8:gK^xK R#5i)rNr )rtrBs& rr2FinnhubClient.calls_this_minute..sA+QqDqq+s" "N)rrsumrBrrBs&@rcalls_this_minuteFinnhubClient.calls_this_minutes5iik ZZZA$++AAZZZs A A& c <V^8dQhRS[/#r7r r9)r;rs"rr<r>sCrcVP4VPPV4pV'dVPR^4^8dV#R# \d'p\ P RT RT 24Rp?R#Rp?ii;i)cNz Quote error r)rLrAquoter@rXrr)rr qrs&& rr\FinnhubClient.quoteso   !!&)AaeeCma/1 9T 9  LL<xr!5 6 s""AAA BA<<Bc <V^8dQhRS[/#rYr9)r;rs"rr<r> scrcVP4VPPVR7# \d'p\P RT RT 24Rp?R#Rp?ii;i)r zProfile error rN)rLrAcompany_profile2rXrr)rr rs&& rprofileFinnhubClient.profile sU  ;;//v/> >  LL>&A37 8 s. AAA)rrBrAN) rrrrrrLrVr\rcrrrs@rr:r:s4'' !BB rr:ca]tRtRtoRtV3RlRltRtRtV3RlRltR t R t R t R t R t V3RlRltRtVtR#)AlpacaWebSocketClienti a Connects to Alpaca's free IEX data stream and subscribes to minute bars for ALL symbols using the "*" wildcard. Received bars are written directly to the shared Database and prices dict. price_velocity is computed from the time delta between consecutive bars for each symbol and stored alongside the price for use as a feature. Runs in a background daemon thread. Reconnects automatically on dropout. c*<V^8dQhRRRS[RS[/#)r7dbrpricesvelocityr5)r;rs"rr<"AlpacaWebSocketClient.__annotate__,s" & &: &t &t &rcWnW nW0nRVnRVnRVn/Vn^Vn\P!4Vn R#FN) rhrirj_running_thread_ws _last_bar_bars_receivedrrr)rrhrirjs&&&&rrAlpacaWebSocketClient.__init__,sC    !^^% rc P\PR4\P!4VnVPVn\ PRVP R\VR^4 24\P!RRR\R\/4pVPV4R#) z'Alpaca WS: connected, authenticating...zWS_OPEN | bars_so_far= | consec_fails= _consec_failsactionauthkeysecretN) rrr _connect_timerr_bars_at_connectrgetattrjsondumpsr%r'send)rwsauth_msgs&& r_on_openAlpacaWebSocketClient._on_open8s => "YY[ $ 3 3243F3F2GGWX_`detuvXwWxyz:: f n '   rc T\P!V4p\V\4'gV.pVEF?pVP R4pVR8XdVP R4R8XdD\ P R4\P!RRRR./4pVPV4KuVP R4R 8Xd\ P R 4KKVR 8Xd7\VP R.44p\ P R V R 24KVR8XdVPV4KVR8XgEK\ PRVP R4 RVP R4 R24EKB R# \d$p\ PRT 24Rp?R#Rp?ii;i)rhsuccessmsg authenticatedu8Alpaca WS: authenticated — subscribing to all bars (*)rw subscribebars* connectedz!Alpaca WS: connection established subscriptionuAlpaca WS: subscribed — bars=z (wildcard active)brAlpaca WS error: z (code=code)zAlpaca WS message error: N)r~loads isinstancerGr@rrrrr _handle_barrrXr) rrmessagerurmsg_typesub_msg bar_countrs &&& r _on_message!AlpacaWebSocketClient._on_messageIs` :::g&DdD))v773<y(wwu~8 $^_"&**$k"se.#(;6 $GH7/ #CGGFB$7 8IKK"A)L^ _`_$$S)(LL#4SWWU^4DGCGGTZOK\\]!^_/2 : LL4QC8 9 9 :sD0E98?E99 F'F""F'c <V^8dQhRS[/#)r7rr5)r;rs"rr<rkjs6363t63rc  VPRR4pV'gR#\VPR^44pV^8:dR#\VPRV44p\VPRV44p\VPRV44p\VPR^44pVPR R4p\P!VP R R 44p \ V P 44p VP;_uu_4VPPV4p V e'V wr\W, ^4pW=, V, pMR pW3VPV&RRR4W P9d&VPPV^V34^,MTp VPPW*W4WVWR R7 W0PV&XVPV&VP;_uu_4V;P ^, unVP R,^8Xd%\"P%RVP R R24RRR4R# \d#\ \P!44p ELi;i +'giEL);i +'giR#;i \d$p\"P'RT 24Rp?R#Rp?ii;i)z Process a single minute bar from Alpaca. Format: {T, S, o, h, l, c, v, t, n, vw} T = message type ("b") S = symbol o = open, h = high, l = low, c = close v = volume, t = bar timestamp (ISO), n = trade count, vw = vwap Sr,Nr[ohlvrRZz+00:00r alpaca)rrz Alpaca WS: ,z bars received totalzAlpaca bar error: )r@rr fromisoformatrRrrrXrrrqrrhrrirjrrrrr)rrrrrrrvolt_strbar_dtrprevprev_tsrrrjrs&& rr!AlpacaWebSocketClient._handle_barjsI- 3GGC$C#''#q/*Ez3773./E3773./D3773./C3773?+CWWS"%E &!// c80LMV--/0 ~~))#.#*.'G!",2G % 2g=H"H')ks#DG..CX++C!UJ4?IJ4AJ ,BJ4):):OP) K%,T?A%F"(,(;(;%!!3D4F4Fq4H3IJ##'#6#6"79 7 GH$11!!%!%!1!1!%!% $$2B$G%)$7$7'$HZ\`\o\o:p$p!$**+D& %%ABSATU23&&!+& ((4T5G5G4HI-->,?@''+':':&;=}}}-s28J8J3JC/PQ 9$?OPTPbPbOccghi!!$8>OPTPbPbOc"de 4 ;< K 4QC89""_T!W5E5E4Fb#LW["\%,T?A%F%J"" Ks!D-J?A J K9 A!K44K9c\'g\PR4R#RVn\P !VP RRR7VnVPP4\PR4R#)z;Alpaca WS: websocket-client not installed, stream disabled.NTAlpacaWebSockettargetdaemonrz Alpaca WebSocket thread started.) _WS_AVAILABLErrrnrThreadrrostartrr4s&rrAlpacaWebSocketClient.starts[} NNX Y  !((0A0A$.?A   67rcRVnVP'dVPP4R#R# \dR#i;irm)rnrprrXr4s&rstopAlpacaWebSocketClient.stops> 888     s9 AAc <V^8dQhRS[/#r6rO)r;rs"rr<rks##s#rcVP#r )rrr4s&r bars_received#AlpacaWebSocketClient.bars_receiveds"""r) r|rrr{rvrqrrnrorprhrirjN)rrrrr rrrrrrrrrrrrrs@rrfrf sO  & &":B6363p  N=^8##rrfc^a]tRtRtoRtV3RlRltV3RlRltR V3RlRlltR tVt R #) AlphaVantageClientiz!https://www.alphavantage.co/queryc <V^8dQhRS[/#r<r9)r;rs"rr<AlphaVantageClient.__annotate__ s---rcWn^Vn\P!4P 4Vn\ P!4VnR#r N) ry _calls_todayrrBdate _last_resetrrrrCs&&rrAlphaVantageClient.__init__ s4#$LLN//1%NN, rc <V^8dQhRS[/#r6r)r;rs"rr<r&s==4=rc@VP;_uu_4\P!4P4pWP8wd^VnWn\ VP4;'dVP ^8uuRRR4# +'giR#;ir)rrrBrrrrryrr^s& r _can_callAlphaVantageClient._can_call&sc ZZZLLN'')E((($%!$) ><^c #i.)5Y+@#h-(4#k*+^  %;!!Q&! KK*6(!CI;ghZqQ RK  LL.vhb< =I s=AG4/D&G4G!/1G4! G1 ,G44 H&?H!H&!H&)rrrryN)5min) rrrrrrrrrrrs@rrrs- .D-- =="""rrcTa]tRtRtoRtV3RlRltRtRtV3RlRltR t Vt R #) PolygonClientiSz%https://api.polygon.io/v2/aggs/tickerc <V^8dQhRS[/#r<r9)r;rs"rr<PolygonClient.__annotate__Vs...rcWn\4Vn\P!4P 4Vn\4Vn\P!4Vn R#r ) ryset_fetched_todayrrBrrrrBrrrrCs&&rrPolygonClient.__init__Vs?$#&5%\\^002"W &^^- rcPVP;_uu_4\P!4pVP'd;WP^,, R8dVPP4KL\ VP4^8d:VPP \P!44RRR4R#RWP^,, , pRRR4X^8gK\P !V4EK +'giL2;irF)rrrBrGrrSrIrJs& rrLPolygonClient._throttle]siikkkkcKKN&:T&AKK'')t{{#a'KK&&tyy{3 s[[^34ax 4 s'DBD D D% c\P!4P4pVP;_uu_4WP8wd!VP P 4WnRRR4R# +'giR#;ir )rrBrrrrclearrs& r_reset_if_new_dayPolygonClient._reset_if_new_dayjsO ##% ZZZ(((##))+#( ZZZs 1A33 B c&<V^8dQhRS[RS[/#rr)r;rs"rr<rqs##s#t#rczVP4VP'dWP9d.#VP4\P !\ 4P4pV\^R7, pVP4^8d)V\VP4^, R7,pVPR4pVP RV RV RV 2p\P!VRRRRR R R VP/^R 7pVP4pVPR 4R9gRV9d.#.pVR,p \V 4Fwr\!V R,R, 4p \#V R,4p V ^8d \#W^, ,R,4MT pVP%WV \#V R,4\#V R,4\#V R,4V\#V PR^44R3 4K VP&;_uu_4VPP)V4RRR4\*P-RV R\/V4 RV 24V# +'giL9;i \0d(p\*P3RT RT 24.uRp?#Rp?ii;i)rI%Y-%m-%d/z/range/1/minute/adjustedtruesortascr.rapiKeyrrresultsrRrr[rrrrpolygonNz Polygon: rz bars for zPolygon error r)OKDELAYED)rryrrLrrBrrrrrCrrr@r~rrrrSraddrrrrXr)rr r^rr\urlrrur rrrrrprev_crs&& rget_prev_day_minute_bars&PolygonClient.get_prev_day_minute_barsqs5  xxx6%8%88I  ||I.335Eya00D||~" t||~'9::}}Z0HYYKq(8 !H:NC,,sJ,3S(DHH,NWY[A668Dxx!)::it>S D9oG#G,SX_-s3x56Uws|C01 #c(OU3s8_#c(OV#''#q/*I  -##''/ KK+fXQs4ykH:N OK  LL>&A37 8I s>C9JC(J(I50J5 J J J:J5/J:5J:)rrrrBryN) rrrrrrrLrr!rrrs@rrrSs( 2D.. !)##rrret_1ret_3ret_5ret_10ret_20rsirsi_diffmacdmacd_sig macd_hist macd_crossbb_pct_b bb_bwidthvs_sma_5 vs_sma_10 vs_sma_20 vs_sma_50 vol_ratiovol5vol10vol20hl_range body_ratiogap_openret_skew autocorr_1 vol_trend price_accelprice_velocityadxadx_posobv_norm vwap_distatr_pctstoch_kstoch_dmfinews_sentiment news_countsec_flagreddit_mentionsreddit_sentimentcongress_boughtstocktwits_bullishstocktwits_mentionsslope_8slope_20 trend_cons_8 trend_cons_20 momentum_age slope_accelyang_zhang_vol vol_imbalancecorwin_schultzsentiment_decayatr_zcTV^8dQhR\PR\R\RR/#)r7r velocity_mapsentiment_scoresr8pd.DataFrame | None)rrr6)r;s"rr<r<s4K'K'r||K'4K'%)K'5JK'rc +\V4^78dR#\P!VPR7pVR,P \ 4pVR,P V4P \ 4pVR,P V4P \ 4pVR,P V4P \ 4pVR,P ^4P \ 4pR\FwrVPV 4W:&K VP4p V P^R 7P^ ^R 7P4p V P^R 7)P^ ^R 7P4p ^d^d^WR ,, ,, , VR &VR ,P4VR&VP^ RR7P4pVP^RR7P4pW, pVP^ RR7P4pVVR&VVR&VV, VR&VV8P \4VR&VP^4P4pVP^4P4pVV^V,, , ^V,R ,, VR&^V,VR ,, VR&R]F?pVPV4P4pVV, VR ,, VRV 2&KA VP^4P4pVVR ,, VR&VP4pR^F'wpp VPV4P4W:&K) WV, VR ,, VR&WG, P4WV, R ,, VR&WtP!^4, VP!^4R ,, VR&VP^4P#4VR&VP^4P%RRR7VR&VP^4P4pVP^4P4pVVR ,, VR &VP4P^4P4VR!&R"VP&9dgVR",P \ 4pVP4P)^^<4P ^<4pVP4V, VR#&MVP4R$, VR#&\*'EdM\,P.P1WVV^R%R&7pVP34VR'&VP54VR(&\,P8P;WHR%R*7P=4pVVP^4P4, VP^4P4P)^^4, VR+&WV,V,^, pVV,P^4P?4VP^4P?4P)^\@PB4, pVV, VR-,, VR.&\,PDPGWVV^R%R&7PI4p V VR-,, VR/&\,PJPMWVV^^R%R17p!V!PO4R2, VR3&V!PQ4R2, VR4&\,P8PSWVWH^R%R67PU4R2, VR7&EMVP4p"V"P^4P4^d,P^^d4VR'&R)VR(&\@PV!VP44V,PY4p#V#V#P^4P4, V#P^4P4^,, VR+&WDP^4P4, VP^4P4R-,, VR.&WV, VR-,, P^4P4VR/&VP^4P[4VP^4P]4p%p$VV$, V%V$, R-,, P^4P4VR3&VR3,P^4P4VR4&R5VR7&T;'g/p&\V4p'\ V&P_R8R,44VR8&\ V&P_R9^44VR9&\ V&P_R:^44VR:&\ V&P_R;^44VR;&\ V&P_RR544VR>&\ V&P_R?^44VR?&R_Fwp(p)V(VP&9gKV)VV(&K VP4P!R`4VR@&VR@,^8P \4VRA&\V4^8EdVR,PY4p*VR,P R,4p+RBp,V,!V+^4P R,4VRC&V,!V+^4P R,4VRD&V+^8P \ 4p-V+^8P \ 4p.\@P`!VRC,^8V-P^4P4V.P^4P44P^^4VRE&\@P`!VRD,^8V-P^4P4V.P^4P44P^^4VRF&VRE,P R54VRE&VRF,P R54VRF&V*P^RR7P4p/V*V/8P \4p0\@Pb!\V44^p2p1\e\V044FFp3V0PfV3,^8Xd\]^V24^,M\[^V24^, p2V2V1V3&KH V1RG, VRH&VRC,VRD,P)^\@PB4, PRa^4P R,4VRI&MRbFp4R,VV4&K ^p5VP%\@Ph4p6VP%\@Ph4p7VP%\@Ph4p8VP%\@Ph4p9V7P!^4p:RJRKV5^,V5^, , ,, p;V6V:, PV54Pk4p\@Pl!V,,P^R 74VRL&WV,V,^, p?V?V,P^4P?4VP^4P?4P)^\@PB4, p@WV, P^4P4P)^\@PB4pAVV@, VAR-,, PRa^4VRM&VP%\@Ph4pBVP%\@Ph4pCVBVC, ^,VBP!^4VCP!^4, ^,,pD\@Pp!VBVBP!^44\@Pr!VCVCP!^44, ^,pERcpFRdVDR5,,VF, VEVF, R5,, pG^\@Pt!VGP^4P44^, ,^\@Pt!VGP^4P44,, pHVHP^RP4P RQ4VRR&\ V&P_R8R,44RS,\ V&P_RR544R5, RN,RU,,\ V&P_R:R,44RN,,\ V&P_R=R,44RO,,RV, pI\ V&P_RW\vPv!4RX, 44pJ\vPv!4VJ, R$, pK^VK)RY, ,pL\ VIVL,4VRZ&R/VP&9d VR/,MWV, VR-,, pMVMP^4P4pNVMP^4P4P)^^4pOVMVN, VO, PRa^4VR[&VP)\@Px\@Px).\@PB4P{4p\V4^8dV#R# \6dR)TR'&R)TR(&ELi;i \6d R,TR+&ELi;i \6d R,TR.&ELi;i \6d R0TR/&E Li;i \6dR5TR3&R5TR4&E Li;i \6d R5TR7&E Lpi;i \6d:TP_R/\Pn!R0TPR74TRL&ELi;i \6d R,TRM&ELi;i \6d RQTRR&ELZi;i \6d R,TRZ&ELi;i \6d R,TR[&ELi;i)eu Builds the full feature matrix for a single symbol. Accepts optional sentiment_scores dict from SentimentEngine.get_scores(). All sentiment features default to 0 if no scores are available yet — the model will treat the stock as neutral until data arrives. Nindexrrrr.rr#)lower)com min_periods)upper绽|=r(r)F)spanadjustr*r+r,r-r.r/vs_sma_r4r8r9r:r;cJ\V4^8dVP^R7#R#)r7)lagr )rautocorrxs&r build_features..s!s1vz!***#:s:r)rawr<r=r>rr?rT)rrrwindowfillnar@rAg9@)rrrsrBr g:0yE>rCrD{Gz?)rrrrr smooth_windowrsY@rErFr2)rrrrrrrsrGrHrIrJrKrLrMrNrO target_ret target_dirc\P!V\PR7p\P!\ V4\P 4p\ V^, \ V44FNp\P!W PWA, ^,V^,P^4^,W4&KP \P!W0PR7#)dtyper`) rarangefloat32fullrnanrpolyfitilocvaluesrSeriesra)sr_x_o_js&& r_slopebuild_features.._slopens1BJJ/BQ(BAE3q6*BrtAvbd(;(B(BAFqI+99Rww/ /rrPrQrRrS4@rTrUg(\?gq= ףp?rVrWrgrhr0gMb`?rXrfr4333333?@last_update_tsrb>@rYrZ))rr#)r$)rr%)rr&)r')rrr2))rr5)rr6)rr7))r@?)rAr)rBr )rCr )rDrt)rEr2)rFr2)rGr2)rPrQrRrSrTrUg0C ?g4y?)>rrrraastyperrs pct_changediffrewmmeanrrollingstdabsshiftskewapplycolumnsrRTA_OKtatrend ADXIndicatorr@rArXrOnBalanceVolumeIndicatoron_balance_volumerTrr volatilityAverageTrueRangeaverage_true_rangemomentumStochasticOscillatorstoch stoch_signal MFIIndicatormoney_flow_indexsigncumsumrrr@wherezerosrrlogvarsqrtrmaximumminimumexprinfdropna)Prr\r]rr[rropvodrdeltaagale12e26r*sigsma20std20rsmavmar1 vol_shortvol_longts_sradx_indobvtpvwapatrrret_sobv_slo14hi14rn_rows_col_defr_retr_up_dn_ema8_above_age_cntr_sf_Nr_c2_h_l_cprev_k_ov_cv_rs_tp_vwap_atr14_lnh_lnl_beta_gamma_k_cs_alpha_spread_raw_last_ts_age_min_decay_atr_s_mu_sdsP&&& rbuild_featuresrs 2w| BHH %A G  E "A F  1  $ $U +B E  !  # #E *B F  1  $ $U +B H  Q  & &u -BQ||AR FFHE !  RR 8 = = ?B ::A:   # # # ; @ @ BB#R:%6!677AeHeHMMOAjM 55b5 ' , , .C 55b5 ' , , .C 9D 8858 ) . . 0CAfIAjMSjAkNcz))#.AlO IIbM   E IIbM   E51U7?+%%@AjMg%%-0AkN iil!Ge 4GA3- **R.   C3;'AkN B61zz!}  "7w1u9-AjMvlln%8AlOGGAJ1771:+=>AjMzz"~**,AjMzz"~++:,AlOzz!}((*Izz"~))+H Hu$45AkNwwy((+002Am rzzD'$$Q+2226ffhm ffho   u ?xx,,"A57-FG";;=AeH"??,AiL .yy994:11B1B1D  3;;r?#7#7#99 [[_002::1a@BAjM /GaK1$BG$$R(,,.B1C1C1E1M1MaQSQWQW1XXD$h4$;7AkN .--00qD1  " !d(+AiL A{{77q1T8SE ;;=50AiL --/%7AiL )yy--qBt. 5)AeH  r*..036<O>S>S>UXY>YZ* YYr]//11aiim6H6H6JT6QR+'a$h/88<AAC)  2**,bjjn.@.@.Bdd(td{T'9:CCAFKKM) ) ,,Q/446) % BA VF"!%%(8C"@AA!!%% A">?AlO!!%% A">?AjM$QUU+>Z[K\KaKaKcDd@de%ll1d3::5A  # !%%(C0 1C 7 !%%*C0 1C 7 8 155-s3 4s :c AC G H !%% C0 1C 7 8 !%%)C0 1C 7  8  !%% 0$))+2DEFYY[8+t38)d*+$TF]3 !*aii!79bg!d(=S#((*#'')11!Q7|s*00Q7'  266BFF7#RVV,335AA" 1&$&s>T!E($1Y<> -#!J-- .3!K.. -!I,- @!I,Sa l@ (S!E((@ OeeIryyQWW/MN O ! /! $# $& #" # ' s  A ASB AS!BAS6:AAT ?AAT$;AU:FAUC+AVCF+AV5I/EAW OB!AW#SASSASSAS3S2AS3S6AT T AT T AT!T AT!T$AT=T<AT=UAUUAUUAAVVAVVAV2V1AV2V5AW WAW W AW WAW W#AW7W6AW7c|a]tRtRtoRt]3V3RlRlltRtRV3RlRlltV3RlR lt V3R lR lt R t Vt R #)SentimentDatabaseiue Lightweight SQLite store for sentiment scores. Separate from the price DB so sentiment writes never block trading writes. Schema: sentiment(symbol, source, score, count, flag, ts, raw_text) symbol — ticker e.g. "AAPL" source — "news" | "sec" | "reddit" | "congress" score — float [-1, 1] composite sentiment count — int number of items contributing to this score flag — int special signal flag (e.g. 1=negative 8-K, 2=positive) ts — int unix timestamp of when this score was computed raw_text— text most recent headline/title for debug inspection c <V^8dQhRS[/#)r7db_pathr9)r;rs"rr<SentimentDatabase.__annotate__srcWn\P!4Vn\P !VPRR7VnVP PR4VP4R#)FrrN) rUrrrrrrr_init_db)rrs&&rrSentimentDatabase.__init__sI ^^% __TYY%H  45 rc\P!VP4;_uu_4pVPR4VPR4VP 4RRR4R# +'giR#;i)a CREATE TABLE IF NOT EXISTS sentiment ( symbol TEXT NOT NULL, source TEXT NOT NULL, score REAL DEFAULT 0.0, count INTEGER DEFAULT 0, flag INTEGER DEFAULT 0, ts INTEGER NOT NULL, raw_text TEXT DEFAULT '', PRIMARY KEY (symbol, source) ) z7CREATE INDEX IF NOT EXISTS idx_sym ON sentiment(symbol)N)rrrUrrrs& rrSentimentDatabase._init_dbsO __TYY ' '4 LL   LLR S KKM( ' ' 's 3A&& A7 c ><V^8dQhRS[RS[RS[RS[RS[RS[/#)r7r rscorecountflagraw_text)r:rr)r;rs"rr<rs:S#e!$03rc \\P!44pVP;_uu_4\P!VP 4;_uu_4pVP RW\V^4WEWvR,34VP4RRR4RRR4R# +'giL;i +'giR#;i)z=Insert or update a sentiment record for a symbol+source pair.a INSERT INTO sentiment(symbol,source,score,count,flag,ts,raw_text) VALUES(?,?,?,?,?,?,?) ON CONFLICT(symbol,source) DO UPDATE SET score=excluded.score, count=excluded.count, flag=excluded.flag, ts=excluded.ts, raw_text=excluded.raw_text NiNN) rrrrrrUrrr) rr rrrr r rrs &&&&&&& rupsertSentimentDatabase.upserts  ZZZ++t eE!ne2PT~VX ,Z++ZZs#)B98B& B9& B6 1B99 C c&<V^8dQhRS[RS[/#rr:r6)r;rs"rr<r/s++#+$+rc RVP;_uu_4VPPRV34P4pRRR4RRR^R ^R ^R RR ^R RR^/pXFSwrErgVR8Xd WSR&WcR&KVR8XdWsR &K$VR8Xd WcR &WSR &K5VR8XdWsR &KBVR8XgKKWSR &WcR&KU V# \P dH\P !TPRR7TnTPPR4.pLi;i +'giL;i)z Returns a dict of all sentiment scores for a symbol. Keys: news_sentiment, news_count, sec_flag, reddit_mentions, reddit_sentiment, congress_bought Returns zeros/defaults if no data exists yet. z
u
Name Type IC Score ▼ Trains Val Acc Train Acc Trades Win % P&L ($) Pos Min Conf Stop % TP %
IC Score History — Top 5 Agents
Training Timeline
Last Weekend Deep Train
u · +100 trees per agent · a agents
Last EOD Incremental Train
u! · +50 trees per agent
Last Checkpoint
Date: u · Agent: last_completedu · Idx: next_agent_idxz

Training Parameters
Daily trees per agentzb
Weekend trees per agentza
Distillation thresholdzh trees
Distillation base treesz\
IC vote thresholdz]
Workers (training)zb
Total trains all agentsu
Per-Agent Training Details
_train_rows_html
AgentTypeTrainsIC ScoreIC History (last 8)Val AccTrain AccIC Trend
Feature Importance — zHighest IC Agentz (IC=aM)
Top Feature Rankings
zv
FeatureRelative ImportanceGain
All zS Feature Columns
c3<<"TFpRS!V4 R2xK R#5i)zrU Nr )rr[rP s& rrr> sPGzFuv`adefag`hhopzFsu
Cumulative P&L Over Time
Trade Log (u total trades)
u
TimestampAgentTypeSymbolSharesEntryExitP&L ($)P&L %Meta ConfReason
Market
StatuszC
ModeuOPEN — collecting barsuCLOSED — sentiment onlyz
TradingPaper (Alpaca)
Starting capital$zU / agent
Total capital$a
Bot Version
Versionv9 (Lifetime Learning)
Agentsrza base+clone + MetaLearner)
FeatureszM
Min trade rowszM
Min train rowszV
Generatedz
VM Resources
CPURAM Used MB (zJ%)
Disk Used GB (zH%)
ThreadszM
Load (1/5/15m)a
Configuration
Training
Daily treeszL
Weekend treeszP
Distill thresholdzK
Distill basezJ
IC vote minzJ
Max workersu
Scheduling
EOD trigger4:15 PM ET post-close
Weekend triggerSaturday 6AM–10PM ET
Backup (market hours)Every 30 min
Backup (off-hours)Every 2 hours
Backup (weekend)Every 6 hours
GitHub pushDaily
rrzutf-8)encodingzHTML dashboard -> r rzKB)zHTML_DASHBOARD | z KB | agents=z | trades=zHTML_DASHBOARD_ERR | )r4 z#58a6ffz#f0883ez#a371f7z#39d353i8r r)6r/base64r~rr.rXrG DictReaderrrBrrCrrr@rrlr NUM_AGENTSr rrTrrrSrrQrrrrrr:rrIrreversedrrDAILY_TRAIN_TREESWEEKLY_TRAIN_TREESrCDISTILL_BASE_TREESrrrr rTrUrrrrr)wrr r_csv_b64r trade_rowsr train_done train_ckptr= r secs_open hours_open mkt_status mkt_colorr5 vmag_listr6 r gen_atrrc r! rC r@ rA rRr% total_posr8ic_valsavg_icbest_icworst_icbest_agrtotal_train_countlast_eod last_wknd last_ckpt cum_pnl_datarunningr4ag_namesag_ic ag_colorsr$ top5 line_colorsic_history_datasetsrrrb r max_hist_lenic_history_labels feat_labels feat_valsr r ram_usedram_totdsk_pctdsk_useddsk_totthreadsload_1load_5load_15 _json_agents _json_trades _json_cum_pnl _json_ic_hist_json_ic_labels_json_ag_names _json_ag_ic_json_ag_colors_json_feat_lbl_json_feat_val_json_feature_cols pnl_colorr& refresh_tagagent_rows_htmlr# r$tctrncvacctrdsr% ic_bar_wic_colorwarntrade_rows_htmlpnl_vclsfeat_rows_htmlmax_imprRr- bar_w_train_rows_html_a_ic_ic_c_atype_badge_blabel_hist _hist_str_trendhtmlr rrrP sw&&& @rr r 3sX'G ))D!;<=J & 3 3qdooa01J4 J YYt$:;< J YYt$@AB ,,z*334KLG "H$&It^C(*J$&,@ *MJ')YI++k2.I++nb1B++h+G++nl;L++lJ7J++ng6FMM+s3I$+CLH$x/K)+MMM.!4LMM,2J#lA"66H..9I../ILG  uSWWUA./ /G   cggk2.uWa(#''(B/"- ! &--W!F))WH- {1~4 s E 1$  !DtDaPL16|1DE1DA6!A#1DEx}}',K(,X__->(?(DE(D15A;(DIEvvi#Gvvi#GvvmQ'Hvvnd+Gvvj!$Gvvna(Hvvot,Gvv&*Gvvi#Fvvi#Fvvj!$Gjj#6LjjD!13?Ljjde!4cBMjj!4cBMjj!2C@Ojj37Njj4KjjC8Ojjc:NjjC8NL#>(A~)9I$q=%y1}e%IAI=rKSOW"A4PPvvlA&vvj!$s*vvk1%vvlBFF=!$<=vvmQ'vvi#vvh"&&.G3wrC//"45 "e 9bEky!6!::y ((*t+78;us C%$D!%&"$(9!! ?DE %cggl1&= >sCD!U"U4L1!U"U3779Q+?%@$FG%%*377;q+A%B3$GH!!$SWWXb%9!: ;<  O/$vN,4#hoo'(! 0oFsKKID#g +,E # #D {+OOTgV"3i(  NLW"BDQQ a(#&%<u _ZfFF6Ng56"(G"3"g-6 b)HH<rs<< e*/eBi%(.BQTUZQ[_`Q`fkr&z?#$&&,XRy9!vvmQ789,,17"SI>&&/[1!vvi3C89!vvk15c:;%h'  R.@ @ @  @ F& @ V'4D%9W@ V:2W@ X3<Y@ X=?Y@ X@IkY@ XJKY@ XLOy>Z]J^Y@ X_$Y@ Z%+3<[@ Z0$[@ \%(L>]@ \2*]@ b+4c@ b5Cc@ bDM+c@ bN c@ d ,e@ d#e@ j$*(k@ j+6k@ v7DD5Iw@ vJ$w@ z%0#5{@ z6({@ @)2{A@ @35A@ @6?KA@ @@AA@ @BEYPS@TA@ @UA@ D#4.E@ D)7E@ J8@nK@ JEK@ N&,O@ N'+O@ N,8*+D*EO@ NFKO@ NLX.O@ NY6O@ T7=S\U@ TB!U@ X") Y@ X.9Y@ X:B#Y@ XG7Y@ ^8Ak_@ ^B7_@ h8I6Ii@ hJ%i@ l&.Jm@ l$//m@ t@Grz|bijlblsA/Bu@ tBDu@ tELMPDQu@ tQGu@ vHOiw@ vP]w@ vnuuwmw]iQXY[Q[~Mao]pw@ vp>w@ x?ES\y@ xJMy@ xNTTWLy@ xY\y@ x]ddg[hy@ xi/y@ @@Grz|bijlblsA/BA@ @BDA@ @ELMPDQA@ @QUA@ @V^_`UaA@ @agA@ @hopqgrA@ @rGA@ BHOiC@ BP]C@ Bnuuwmw]iQXY[Q[~Mao]pC@ BpGC@ DHOqkE@ DR/E@ L@Grz|bijlblsA/BM@ LBDM@ LELMPDQM@ LQUM@ LV^_bUcM@ LciM@ LjqruivM@ LvGM@ NHOiO@ NP]O@ Nnuuwmw]iQXY[Q[~Mao]pO@ NpGO@ PHOsmQ@ PT;Q@ ^C @ B ?InnM]^c>d=eC @ B foC @ B pzo}o}OPUpVoWC @ B WVC @ N WhUhO @ N iXO @ P YkWkQ @ P lWQ @ R XiViS @ R jXS @ T YkWkU @ T lRU @ V ShhkQlW @ V mSW @ X TcSgSgfgRhY @ X iXY @ Z YjWj[ @ Z k9[ @ H :=W[[Pb=c9d8eI @ H fkI @ H lssvjwI @ H xI @ X !!Y @ X "$Y @ d %/HLC @ B ICC @ D DUBUE @ D VCE @ F DUBUG @ F VLG @ H MS8I @ H TEI @ T V]]_U_\xACyCetIWEXU @ T XZU @ T [bcfZgU @ T g=U @ V >FaLW @ V IOW @ V PWWXkW @ V Z_W @ V `ggj^kW @ V l>W @ X ?Gs^Y @ X LRY @ X SZZ]Q^Y @ X _dY @ X ellocpY @ X q?-b$hZ|CL>Q[\_`j\k[lmn{    4 3 3          >^8    .D0FFT. - - :4QC899:s AHAH*AHAH**AH< AI3AI  AI A5AI%AI8%AI=*AJ AJ$AJ EAJ%E'AJE9B AJ%H AHHAHH AH' H!AH*H'AH*H* AH9H8AH9H< AI I AI I AIIAII% AI5I4AI5J AJ" J AJ%J% AKJ0AKKAKc<V^8dQhR\R\R\/#r7rr rr )r;s"rr<r< s+{@{@${@K{@{{@rc1 a\P!4p\P!\4P R4pVP o\ 4pRp.pVEFp/p .p Rp ^p \VPR4'dVPPp \VPR4'dVPPRXRp \VPR4'dVPP4p MRp \VPR4'dVPPp VP'dVPRYRM.pTP/R VPbR VP 'dR MR bR V!VP"4bRV!VP$4bRV!VP&4bRV!VP(4bRVP*bRVP,bRV!VP,\/VP*^4, 4bRV!V 4bRV Uu.uF q!V4NK upbRV bRV!V 4bR\VPR4'dVPP0M^bRV!VPP24bRV!VPP44bRVPP6bRV!VP84RV!VP:4RV!VP<4RV!VP>4RVP@RVPBR V!VPD4R!V!VPF4R"\IVPJPM44R#\OVPJ4R$\Q\SV PU4R%R&7R',4R(VRZRUu.uFpR)VPWR)4R*V!VPWR*^44R+V!VPWR+^44R,V!VPWR-^44R.VPWR.R/4R0V!VPWR0^44R1V!VPWR1^44/NK up/ C4EK VPYR2R3R47\SSPU4R5R3R47R6,pR7TR8TR9R:R;\[4R\^R?\`R@RA\OV4RV!\cRBV444RCV!\cV3RDlV444RE\cRFV44RG\cRHV44RV!\cRIV44\/\cRJV44^4, 4RK\cRLV44/RMTRNRVP6RV!VP24RV!VP44RT!\VR4'dVP4M^4/RORP\OS4RQVPe4/RRVUUu/uFwppVV!V4bK upp/ pRSp\gVRT4;_uu_4p\hPj!VV^RU7RRR4\lPoRVV 24R#uupiuupiuuppi +'giL:;i \pd$p\rPuRWT 24Rp?R#Rp?ii;i)[z v9: Write logs/claude_handoff.json -- structured data for Claude analysis. Jake can paste this file directly to Claude for deep analysis. Updated every hour alongside the human report. r cP\\V4^4# \dR#i;i)N)rrrXrms&r safe_float)_write_claude_handoff..safe_floats %(A& &%%s  %%Nrrrr rrrrS rr rr)r*r(rrRric_scorer=rrrrrr r kelly_wins kelly_losses kelly_avg_winkelly_avg_lossr rW r< cV^,)#rr rms&rro'_write_claude_handoff..Js AaD5rrr r* r r$r% predictedr&r(r,r*r+c(VR,;'g^#rr rms&rror Zs!K."5"5A"5rTrcV^,#rr rms&rror ]sqtrrIr r r r r r r r r6 r5 rc c38"TFqPxK R#5ir rr s& rr(_write_claude_handoff..js,I&Q[[&r r:c3D<"TFqPS4xK R#5ir )r:)rr8ris& rrr ks,TV^^F-C-CVs r@ c38"TFqPxK R#5ir r r s& rrr ls!;Fq((Fr rA c38"TFqPxK R#5ir r r s& rrr ms!9&Q&&&r c38"TFqPxK R#5ir r r s& rrr ns,DVVVVr c38"TFqPxK R#5ir r r s& rrr nsNhag\]xxagr r7 c3L"TFp\VP4xK R#5ir r r s& rrr os!CFq#akk"2"2Fr r meta_learnerrun_pricesr top_pricesrrrx zClaude handoff -> zCLAUDE_HANDOFF_WRITE_ERR | iirx);rrrBrrCrir rrrrrrrrSrrr rr)r*r(rrr=rrrrrr rrrrr rGr rrr6rQrr@rrrrlrrTrr.r~rrrrXrr)rr rr^r= r r ra rr, ic_histpsirrr* rnrR top_symbolsrr[r handoff_pathrrris&&& @r_write_claude_handoffr s+ yy{F||J'001HIGyyF "C&J  288. / /))B 288\ * *hh))#$/G 288\ * *,,.JJ 288^ , ,((//K-/JJJ 34(B ) RWW)  W)  Z 3)  Z 5 ) Z8 ) Z 6 )  RYY)  RWW)  Z#bii2C(CD)  Z 3)  W=WjmW=)  [)  Z 3)  GBHHl4S4SRXX00YZ)  Z(8(89) Z(:(:;!) " RXX--#) $ Z(8(89 z"*<*<= Z 4 Z7 R^^ R-- Z(9(9: Z(:(:; T",,"3"3"56 c",,/ T&"I#"NO 'st, -AxAEE%O!<AEE)Q,?!@AEE/1,E!Fx!4AEE*a,@!AAEE+q,A!B- ;) ) )@OO5tOD^TJ3OK 764>+3+:< c&k j,I&,I)IJ j,TV,T)TU c!;F!;; c!9&!99 j,DV,D)Ds3NhagNhKhjkGl)lm c!CF!CC  : $,, *T\\2 *T^^4 *'$ :U:UT__%6[\]   F  0   D fc1sJqM) D;G@.L@ , $ $ IIgq +% (78U>$ bE % $ @:1#>??@sC0Y2B&Y7:Y<8"Z6Z Z Z Z [ Z>>[c<V^8dQhR\R\R\/#r r )r;s"rr<r<s&^;^;$^;K^;{^;rcN \^ 4\PR4\P!\ 4P R4pRpVP4pTRV R2VP4R\ R\ R\ R\ R 2 R VP R V'dVR R 2MR R\VP4 2VRR RR RR RR RR RR RR RR RR RR RR R R! R"R! R#R$ R%R! R&R' R(R' 2R.pVEF!pVP!VP"4pVR),'dR*MR+p VR,,eVR,,R R 2MR.p VR/,eVR/,R R 2MR.p VP%VR0,R V R R1VR2,R3 R1VR4,R3 R1VR5,R3 R1VR6,R3 R1VR7,R3 VR8,R VR9,R: V R V R VR;,^d,R< R=VR>,^d,R< R=VR?,R$ VR@,RA VRB,R' VRC,R' 24EK$ \'RDV44p \'REV44p \'RFV44p\'RGV44p\'RHV44p\'RIV44p\'RJV44p\'RKV44p\'RLV44pW, pVV, pTRRMV RN ROV R RPVR RQT RRV'dVV, ^d,M^RS R=2 RTVRN ROV R RPVR RQV RRV\)V^4, ^d,RS RUVRN ROVR RPVR RQV RRV\)V^4, ^d,RS RV2RW., pVP*'dUVRXRY., p\-VP*P/4RZR[7FwppVP%R\VR] R^VR_ 24K! \-VUUu.uFqwP0RR-FpVNK K uppR`RaRb7Rc,pV'Ed3VRXRd., pVP%R\RR R^ReRf R^RgR R\RhRi R\RjRi R\RkR! R\RlR! R\RmR! R\RnR! Ro24VP%R4VFpVP3Rp\5VRq,^d, VRr,^d, , 4^d,4pVP%RsVR0,Rt RuVRv,Rf RwVR5,Rx RyVRq,Rz R{VRr,Rz R|VRA R}VP3R~^4R R\VP3R^4R R\VP3R^4R R\VR, 24K VP%VR,4\6P9RRP;V4,4\<P9R\> 24\AWW&4\IWV4R-#uuppi \Bd#p\DPGRT 24R-p?L=R-p?ii;i \Bd$p\DPGRT 24R-p?R-#R-p?ii;i)r hourly_reportrzHOURLY REPORT  CSTz CPU cores: z | Agents: rz base + z clones)zMetaLearner: trained=z discrepancy=rppr z profitable_symbols=r z<24rhz>2Equityr CashNetPnLGrossWin GrossLossr r zWin%AvgDiscr RollDisczSL%r zTP%MaxPr Confr r RstrrlBr{Nz N/Arrrrz>9,.2fr r$r)r*r(r'z>6.1%rz>5.1frrrr z>5.2fr rc38"TFqPxK R#5ir rr s& rr hourly_report..s1&Q[[&r c38"TFqPxK R#5ir )r)r s& rrr s4V^^Vr c38"TFqPxK R#5ir )r*r s& rrr s26a\\6r c38"TFqPxK R#5ir r r s& rrr s.v!XXvr c38"TFqPxK R#5ir r r s& rrr s,VVVVr c3<"TFp\VRR4xK R#5i)rr Nr}r s& rrr sI&QWQ3C88&c3<"TFp\VRR4xK R#5i)rr Nr r s& rrr sG1WQ1#66r c3<"TFp\VR^4xK R#5i)rNr r s& rrr sA&QWQ~a00&r c3<"TFp\VR^4xK R#5i)rNr r s& rrr s?1WQ|A..r z TOTALS: NetPnL=$z>+.2fz GrossProfit=$z GrossLoss=$z Trades=z WinRate=rz LONG: NetPnL=$z% SHORT: NetPnL=$z% zf T=type(B=base,C=clone) AvgDisc=avg pp discrepancy(lower=better) RollDisc=last-20-trade discrepancyr,zSector Performance:cV^,)#rr rms&rrohourly_report..s qterrr z<38rz>+.4fc&\VR,4#r)rr s&rror s c!E(mrTrrIz$Top Recent Trades (sorted by |PnL|):r r PnLzActual%r zPred%DiscOwnCfMetaCfEffCfz Reasonr'r%r&rr rr z PnL=r z actual=r z% pred=r zpp r*z>5.3fr+r,r(r zReport written -> zHUMAN_REPORT_ERR | zCLAUDE_HANDOFF_ERR | z======================================================================================================================================================z------------------------------------------------------------------------------------------------------------------------------------------------------izk ---------------------------------------------------------------------------------------------------------)%rrr rrBrrCr{rr rf BASE_AGENTS CLONE_AGENTSrrrrrirSrTrrrQrrr@r report_loggerrrrrr1 rXrrr )rr rrG r meta_discr r8rtagrrdrtotal_gptotal_gltotal_trdshort_gpshort_glshort_tshort_wlong_net short_netrperfrR all_tradesr&rs&&& rr r s bM_-||J'001DEGC$$&I '$'  n%]:,b XVbUcckl  ~./8)C+eDE!$"9"9:; = 3-Bx~fS\(3 c ;s+HR= R.Bbz% "+fR[r 5* 6  Eii "z]]c234E2F2S$%c*"-Yb234F2G2S%&s+2.Yb z#s2ha( F';1Qy\&u)EQ|B* e4Q{^B4G( TVGW  Y 1&11I4V44H2622H.v..G,V,,GI&IIHGGGHA&AAG???G$HH$I  i.ohs^Ls^9WI6*177?3&q=Q @ Xe,OHS>Js^9WIZGTU@VWZ@Z[^?_`&u-_XcNKs^9WIZGTU@VWZ@Z[^?_`   -  E ~~~ "+,, 4 4 6OLIC LL2c#YaU|4 5M4FqIIcdOqOF4 #T  Jz "<== r'#abz5*BynB|2fR[72,b" R|8- .  %&A55C) S(81_;Mc;Q(Q$RUX$XYD LLaj%R( B'78x'y9f0EF/*62#d5\55A&u-Rk!0DU/K255A&u-R( } >  LLttdii../ KK$_$5679F4;f$/9 52 922$7889 ;4RD9::;s6 W % W2 W6 W3W..W36 X$XX$c0a]tRtRtoRtRtRtRtVtR#)MarketAwareRetrainScheduleria v9: Simplified scheduler -- intraday retraining removed. Training fires ONCE per day, 15-30 min after market close. The _after_hours_train() method handles the full sequential cycle. The scheduler.tick() is kept for future use but does nothing during hours. c.WnRVnRVnR#)rFNr)callback _last_minute_did_eod)rr s&&rr$MarketAwareRetrainScheduler.__init__s$ ! rcR#r r r4s&rtick MarketAwareRetrainScheduler.ticks r)r r r N) rrrrr rr rrrs@rr r s "   rr c$V^8dQhR\/#r6rO)r;s"rr<r<src>\\P!44#r )rrr rrunix_tsr s tyy{ rc0V^8dQhR\R\/#)r7rr8rr:)r;s"rr<r<s88#8#8rc^VR, R,pVR,R VR,^<,R R2#)zUnix int -> HHMM CST string (no colon, Python 3.12 safe). CST = UTC minus 21600 seconds. Example: unix_ts() -> 1712345678, ts_to_cst(...) -> 1423 CST `Trerc02dr r )rrs& r ts_to_cstr$ s5 euA4i_a$h2-c2$ 77rallcTa]tRtRtoRtRtV3RlRltRtV3RlRltR t Vt R #) DataCollectionHealthizPer-source diagnostic metrics. Populated by _health.record() calls throughout the data pipelines. Read by _run_collect_only() health reports.c\P!4Vn^Vn^VnRVnRVn^Vn^Vn^Vn RVn RVn ^Vn ^Vn RVnRVn^Vn^Vn^VnRVn^Vn^VnRVnRVn^Vn^VnRVn^Vn^VnRVn^VnR#)r FNr,)rrrr alpaca_errorsalpaca_connectedalpaca_last_baralpaca_consec_failsr fh_errors fh_last_callfh_last_symbol news_fetches news_errors news_last_tsnews_last_symbol sec_scans sec_errorssec_filings_found sec_last_ts st_fetches st_errors st_last_tsst_last_symbolreddit_fetches reddit_errorsreddit_last_tscongress_scanscongress_errorscongress_last_tsdb_bars_writtenr4s&rrDataCollectionHealth.__init__s^^% 1d0 %dt';#$  A4> $"5!t/ "$"7aDO!"tD$4aT^b 3a!3t9L!5SW4;P rc <V^8dQhRS[/#)r7rr9)r;rs"rr<!DataCollectionHealth.__annotate__2s#;#;S#;rc 8VP;_uu_4VR8Xd=V;P^, un\P!4VnRVnEMVR8Xd1VP RR4VnVP R^4VnEMnVR8XdDV;P^, unVP RVP ^,4VnEM$VR8Xd}V;P^, un\P!4Vn VP RR4Vn VP R 4'dV;P^, un EMVR 8Xd}V;P^, un \P!4Vn VP RR4VnVP R 4'dV;P^, unEMVR 8XdV;P ^, un\P!4VnV;P$VP R ^4, unVP R 4'dV;P&^, unEMVR 8Xd}V;P(^, un\P!4VnVP RR4VnVP R 4'dV;P.^, unEMVR8XdeV;P0^, un\P!4VnVP R 4'dV;P4^, unMVR8XdeV;P6^, un\P!4VnVP R 4'dV;P:^, unM0VR8Xd*V;P<VP R^4, unRRR4R# +'giR#;i) alpaca_barTalpaca_connectr consec_fails alpaca_errorr7r r,rrrfilingsrrrdb_writerN)rrrr+ r* r@r, r) rr. r/ r- r0 r2 r3 r1 r4 r7 r6 r5 r8 r: r; r9 r< r> r= r? rA r@ rB )rrrs&&,rrDataCollectionHealth.record2s ZZZ<'  A% diikt';(,%+++-66+t+D%+-66.!+D(>)""1,"+-66.373K3Ka3O,Q(9$ "  D$5&(ffXr&:#66'??DNNa$7N6!!!Q&!DIIK(9(*x(<%66'??D$4$4$9$45!# T%5&&"&&A*>>&66'??DOOq$8O<'1$ do&(ffXr&:#66'??DNNa$7N8###q(# $*=66'??D$6$6!$;$6:%##q(#$))+$*?66'??D$8$8A$=$8:%$$w(::$EZZZs6D,PBPBPBPA+P A*P4A P P cVfR#\P!4V, pV^<8dVR R2#VR8dV^<, R R2#VR, R R2#)Nneverrzs agorczm agorzh ago)r)rrr8s&& rrDataCollectionHealth._ageWsY :g IIK"  r6qgUO+ t8qtCj..D&U##rc <V^8dQhRS[/#r6r9)r;rs"rr<rE ^srczVP;_uu_4VP'dRMRVP R2pRPRR 2RV RVPR RVP VP 4 R VP 2R VPR R VP VP4 R VP R VP 2R VPR R VP VP4 R VP R VP 2RVP RVP" R VP VP$4 R VP& 2RVP(R R VP VP*4 R VP, R VP. 2RVP0 R VP VP24 R VP4 2RVP6 R VP VP84 R VP: 2RVP<R R2RR 2. 4uuRRR4# +'giR#;i) CONNECTEDzDISCONNECTED(fails=rr z[DATA-HEALTH] zATA-HEALTH] Alpaca WS : rrz | last_bar=z | errors=z![DATA-HEALTH] Finnhub : calls=z | last=z | sym=z#[DATA-HEALTH] News RSS : fetches=z![DATA-HEALTH] SEC EDGAR : scans=z | filings=z#[DATA-HEALTH] StockTwits : fetches=z#[DATA-HEALTH] Reddit : fetches=z![DATA-HEALTH] Congress : scans=zATA-HEALTH] DB writes : z barsNz:==========================================================)rr* r, rrrr+ r) rr. r/ r- r0 r2 r3 r1 r4 r6 r7 r5 r8 r: r; r9 r< r> r= r? rA r@ rB )rrs& rrDataCollectionHealth.report^s\ ZZZ!%!6!6!6+,T-E-E,FaH 99 )-bT$:J:J19MN IId&:&:; r5 r6 r7 r4 r9 r8 r; r: N) rrrrr rrrrrrrs@rr' r' s*R!2#;#;J$rr' c ^RIpVPVP4PR,pVPVP4pVPpVP p\ P!4p\R4;_uu_4p\RVP4P444pRRR4\XPRR44R,R,p\VPRR44R,R,p \R4;_uu_4pVP4P4R ,p R P!V 4p RRR4^RIp \%T P&!R T P(!4 R 244p \*P-RT RT RX RT RT RTR RTR RT 24\R4;_uu_4p\/TP4P4^,4\0, ^d,pRRR4\3XY4\R4;_uu_4p\RTP4P444p\TR,P4^,4R, p\TR,P4^,4R, pRT\5T^4, , pRRR4\R4;_uu_4pTP74P4pRRR4\/X^,4\9RTR,44R ,, p\;X \<4'd"\/T PR 4^,4M\/T ^,4p\?RT\5\0^4, 4p\0pTR"8d\5^T^,4pMrXR#8d^pMhTR$8gTR%8d\5^T^,4pMFTR&8gTR'8d\5^T^,4pM$TR8d\5^T^,^,4pMTpT\@8wd.\*P-R(\@ R)T R*TR+ R,XR+ R-TR+ 2 4Ts \DPF!\H4EK +'giEL;i \dR/;rELi;i +'giEL;i \dR p ELi;i \dR/p ELi;i +'giEL;i \dEL i;i +'giELa;i \dRpELti;i +'giELN;i \dR!pEL*i;i \dR!pELi;i \d$p\*PCR.T 24Rp?EL5Rp?ii;i)0z Background thread: logs system resources every 30 seconds. Writes to debug.log with prefix RESOURCE so you can grep it. Helps correlate CPU/memory/I/O spikes with Alpaca ping timeouts. Run: grep RESOURCE ~/trading/debug.log | tail -50 Nrz /proc/self/ioc3V"TFpRV9gK VPR4xK! R#5i)rNr r s& rr)_resource_monitor_loop..s'#_;QaUY]^U^MAGGDMM;Qr rchar0wcharr :NrNrr\z/proc/z/fdzRESOURCE | rss=z MB | threads=rz | io_read=zMB | io_write=zMB | cpu_user=rz s | cpu_sys=zs | fds=rfc3V"TFpRV9gK VPR4xK! R#5ir r r s& rrrW 'Y5LPSWXPX|qwws||5Lr r r rfr2z /proc/statc38"TFp\V4xK R#5ir r)rrns& rrrW s8Y=aq=r :rNNrPr rEg)\(?g(\?r3g?g?zDYNAMIC_WORKERS | r | cpu=z.0%z ram=z iowait=zRESOURCE_MONITOR_ERR | r)%resource getrusage RUSAGE_SELF ru_maxrssru_utimeru_stimerr r.r6rir rr@rXrrrTrrgetpidrrrr _record_resource_snapshotrreadlinerTrr:rrrrrI_RESOURCE_MONITOR_INTERVAL)_resrss_mbcpuuser_ssys_s n_threadsrio_linesread_mbwrite_mbrr_osn_fds_lf_cpu_pct_mf_mi _ram_total _ram_avail _ram_used_pctr _cpu_line _iowait_pct_load1 _cpu_pct_now _max_workers_targetrs r_resource_monitor_loopr s a >^^D$4$45??4GF..!1!12CllFllE"..0I (/**b##_2779;O;O;Q#__H+x||Gc:;tCtKx||Gc:;tCtK  /**b779??,R0D"xx~H+  CKK&c(BCD   !&ykB zWI^H:N"3<|E#;hugO   /**c$SXXZ%5%5%7%:;nLsRH+)(FF $/**cYSXXZ5J5J5LYYC!$S_%:%:%%>%@%C!Dt!KJ$':J8J+J$KM + ",''3 #  4 4 6I(#IaL1S8Y9UW=8Y5Y\`5`a  6@s6K6Ktzz#q12QVW[\]W^Q_ Vc.!.D%DEL*LT!a!23%%)<a!23%)<a!23$a!1Q!67&**!!()9(:$wiH',E-1DH[Y\L]_$+  -.i+** (%''( ( +**    +**  +**  $ #  $ ('' "!  "  2 >   !8< = = >sA4V+<S/R<>ASS9,7S%#S9,2T /V+T5!AT!"T57U B%U/U8V U/*?V*A V3C,V+< S  SS"V+!S""V+% S6 0S94V+6S99 T V+ T  V+ TV+TV+! T2 , T55 UV+UV+ U UV+U U,(V++U,,V+/ V : V VV+VV+ V($V+'V((V++ W6WWc\P!\RRR7pVP4\P R4R#)z-Start the resource monitor background thread.TResourceMonitorrz'RESOURCE_MONITOR_STARTED | interval=30sN)rrr rrrr s rstart_resource_monitorr s2 6t/ 1AGGI?@rgffffff?rrc$V^8dQhR\/#)r7rrO)r;s"rr<r<s  S rcd\P!V4R# \\3dR#i;i)zSet CPU scheduling priority of the current thread. Negative = higher priority, positive = lower. Range: -20 to 19. Silently ignored if process lacks permission to increase priority.N)rr nicePermissionErrorOSError)rs&rrrs)   W %   s //c$V^8dQhR\/#r6rO)r;s"rr<r<)s   rc\R4FCpVPR4'gK\VP4^,4R,u# ^# \d^#i;i)z7Current process RSS in MB. Zero-cost diagnostic helper.r]r^rr_)r`s r_rss_mbr )s\ ,-Dx((4::<?+t33.     rcc$V^8dQhR\/#r7rr9)r;s"rr<r<3sIICIrc \4p\;'g^pV'dW, ^d,R R2MRp\PRV RVR RV R24\PR V R V R V R 24R #)zCLog current RSS to both trading.log and debug.log with a clear tag.rz% of capuncappedz[RAM] rrra rz RAM_TRACE | rgz MB | cap=rN)r rhrrr)rmbcaprcs& rrlrl3ss B //C),RVCZ H %*C KK&s2a&cU!45 UG72$iuBGHrca]tRtRtoRtV3RlRltRtRtRV3RlRlltRV3R lR llt ] V3R lR l4t ] V3R lRl4t ] V3RlRl4t RtVtR#) ResourceGuardi;a Central resource monitor and throttle controller. All background threads call yield_p3() or yield_p4() between work units to cooperatively yield when the system is under load. Usage in a background thread: _resource_guard.yield_p4() # will sleep if load is high do_expensive_backup_work() _resource_guard.yield_p4() # check again after work Grep debug.log for 'RESOURCE_GUARD' to see throttle events. Grep debug.log for 'RESOURCE |' to see load history. c <V^8dQhRS[/#)r7ncpusrO)r;rs"rr<ResourceGuard.__annotate__Js ! !c !rc\V^4Vn\P!4VnRVnRVnRVnRVnRVn RVn RVn ^Vn RVn RVnR#)rr FN)rr rrr_load_1m_load_5m _load_15m _throttle_p3 _throttle_p4 _pause_p4rnr _ram_total_mb_ram_pct)rr s&&rrResourceGuard.__init__Jsg ] &^^-      """" !  rc  RVn\P!VPRRR7P 4\ P RVP R\^d,R R\^d,R R24R #) z.Start the background resource monitoring loop.Tr rzRESOURCE_GUARD_START | ncpus=z | nominal=rz% | cap=rN) rnrr_looprrrr LOAD_NOMINALLOAD_CAPr4s&rrResourceGuard.startXsi  4- //4uw+DJJ<8#C',HXc\#4Fa I rcN\^4VP'Ed\R4;_uu_4pVP4P 4pRRR4\ X^,4p\R4;_uu_4p\ RVP4P444pRRR4\XPRR4P 4^,4R,p\VPRR 4P 4^,4R,pWg, pV\V^4, p \e4V\\R ,48p V\\R ,48p M V R 8p V R 8p \ V^,4p \ V^,4p W0P, pV\8;'gT pV\8;'gT pV\8;'gT pVP;_uu_4VP VP"3pW0nWnW`nWnWnWnWnVVnVVnRRR4VV3pVX8wd^\2P5RVR RVP RV^d,R RV RV RV ^d,R RV RV RV^, RV^, R24\2P7RVR RV R RV R RV^d,R RT RT RV ^d,R RV'dR M V'dR!MR" 24\:P<!\>4EK-R# +'giEL;i +'giEL;i +'giEL;i \8d#p\2P7R#T 24Rp?LRp?ii;i)$r r Nrfc3V"TFpRV9gK VPR4xK! R#5ir r r s& rr&ResourceGuard._loop..mr\ r r z 7400000 kBrr z 4000000 kBr3 ףp= ?g333333?rz#RESOURCE_GUARD_STATE_CHANGE | load=rrzcpu (rz %) | ram=MB/zMB (z%) | throttle_p3=z | pause_p4=z | prev=(rrzRESOURCE_GUARD | load=r^ z% | ram=zMB(z %) | state=PAUSE_P4THROTTLENOMINALzRESOURCE_GUARD_ERR | ) rrnr.rirrr6r rr@rrhr r r rr r r rr r r r r rrrrXrrIRESOURCE_CHECK_INTERVAL)rrr r rv rw _total_mb _avail_mb_used_mbr _ram_throttle _ram_pauser r load_pct throttle_p3 throttle_p4pause_p4 prev_state new_staters& rr ResourceGuard._loopbsH! mmm< @/**bGGIOO-E+ q?/**cYSXXZ5J5J5LYYC+ | D J J LQ OPTXX | D J J LQ OPTXX %1$s9a'88)$,s:3D/E$EM$,s:3D/E$EJ$,tOM$,tOJ q? q?"ZZ/',6HH= ',6HH= '(2EE:ZZZ"&"3"3T^^!DJ(/M(0%(1&(0M(/M(0N(3%(3D%(0DN )(3  * %% '}Adjj\x|C>PQ'jI;d8C<:LM''2m<zJ!!+AqAq B"",WSM73-qRUW#C<,-#*C {#hsl35GH+3Z{Xabd JJ. /+** +**, ZZ< @""%:1##>?? @syM7L;-M7?/M.D.M7M70M7AM#B/M7 M7 M7; M  M7 M  M7# M4 . M77 N$NN$c <V^8dQhRS[/#r r9)r;rs"rr<r s++c+rc VP;_uu_4VPpRRR4X'd=\PRV R\ R24\ P !\4R#R# +'giLV;i)z|Cooperative yield point for P3 (LOW) threads. Sleeps extra when system load is high. Always returns -- never blocks forever.NzRESOURCE_GUARD_THROTTLE_P3 | | sleep=r)rr rr_THROTTLE_DELAY_P3rrI)rrthrottles&& rr ResourceGuard.yield_p3s[ZZZ((H    !>ugYOaNbbcd e JJ) * Zs A00 B c <V^8dQhRS[/#r r9)r;rs"rr<r s++c+rc  VP;_uu_4VPpVPpRRR4X'dL\P RV R\ ^d,R R\ R24\P!\ 4R#X'd=\PRV R\ R24\P!\4R#R# +'giL;i) zmCooperative yield point for P4 (BACKGROUND) threads. Pauses when load is at cap, sleeps extra when throttled.NzRESOURCE_GUARD_PAUSE_P4 | z | load_cap=rz% exceeded | pausing rzRESOURCE_GUARD_THROTTLE_P4 | r ) rr r rrr _PAUSE_DELAY_P4rrIr_THROTTLE_DELAY_P4)rrpauser s&& rrResourceGuard.yield_p4sZZZnnE((H    ,UG4$SL--B?BSSTV  JJ '    !>ugYOaNbbcd e JJ) *Zs C C c <V^8dQhRS[/#r6r)r;rs"rr<r s..%.rcVP;_uu_4VPVP, uuRRR4# +'giR#;ir )rr r r4s&rr ResourceGuard.load_pcts' ZZZ==4::-ZZZs = A c <V^8dQhRS[/#r6r9)r;rs"rr<r s P P Prc VP;_uu_4VPVP, ^d,pVP^d,pVPpVP 'dRVR RV RVR R2uuRRR4#VP 'dRVR RV RVR R2uuRRR4#R VR RV RVR R 2uuRRR4# +'giR#;i) r8z CRITICAL(cpu=rz%,ram=r z %) P4-PAUSEDNz HIGH(cpu=z%) P3-P4-THROTTLEDz NOMINAL(cpu=r )rr r r rr r )rr r ram_mbs& rrResourceGuard.statuss ZZZmmdjj036Gmmc)G''F~~~&wsm6&WSMQ]^ Z """"73-vfXS M_`Z"'#fVHC}BOZZZsA#CC C- C C c <V^8dQhRS[/#r6r9)r;rs"rr<r sSS#SrcVP;_uu_4VPR RVPR RVPR 2uuRRR4# +'giR#;i)rrN)rr r r r4s&rrResourceGuard.load_strs@ ZZZmmC($--)4pVP)VRR^R!V R"2R7VP)VRR^R#V R"2R7\8'd+VP)\8R$R%R&R'\8R(, R) R*2R7VP/R+4VP1^VR,,4VP5^R7VP7RRR7VP'W}R-^R7VP%W}RR-R 7VP/R.4VP1^\3\3V 4^,^44VP7RRR7VP<P?VPAR/44VP<PCVPE44VPF!^R07VPH!4VP!4P#R14p\JPLPO\PR2V R324pVPR!V^dR4R57VPT!V4\VPYR6V 24\PYR7V R8\V4 24R# +'giEL;iuuppiuuppiuup piuup pi \Zd\PR94R#\\d&p\P_R:T 2RR;7Rp?R#Rp?ii;i)?z Generate a resource usage chart (CPU%, RAM MB, thread count) and save to charts/. Called once after market close alongside the accuracy chart. Uses only stdlib if matplotlib is unavailable. Nr)rz+RESOURCE_GRAPH | not enough data points yetT)rsharexzResource Usage -- rr)rrr4 steelblue)rrrr orangerz Nominal (rr )rrrrredzCap (z CPU Load %皙?)rrE)rcoralr r3r z Throttle (rzPause (darkredr rhz Hard cap (rrzGB)z RAM Used (MB)ra mediumpurplezActive Threadsr r r resources_rr)rrzResource chart saved -> zRESOURCE_GRAPH_SAVED | z | samples=z;RESOURCE_GRAPH | matplotlib not available -- skipping chartzRESOURCE_GRAPH_ERR | r)rg@g@)0r* usematplotlib.pyplotpyplotmatplotlib.datesr8 rr rGr rrrrr r rBrCr0 r/ r1 r r r3 r2 rr& gridrhrr6 r7 r9 set_major_locator HourLocatorxticksr' rTrUrrr( rrr ImportErrorrXr)r* r mdatesrrrRr> timestampsr[cpu_pctsrram_mbsrr figax1rl ax3_cap_mb_thr_mb_pau_mbrout_pathrs rgenerate_resource_graphr s HGu')+ # #,-G$ w?weab&&q)w ?*12'JA!Qa'2*12'JAqQa'2*12'JAq!a'2"||Aq(4P_c3 )"&&(*;*;J*G)HITVci j S L [CH L3&h$RS]fgstwgwx{f||~[ A HsN%41V[\deh\hil[mmoTp q |$ QCMC/56 A  S! CwG GsC * 6*D)3#gn%[9I)3#gn%[9I G8tq&wis3  5 G5DA#G9C0  2 : KK )sc *:d?3*?sC  E ' Q# & A  S! NaH C~N '( QCL1,b12 S! %%f&:&:7&CD ##F$6$6$89 B  VVX  } -77<< jD,AB H#7; # .xj9:3H:[WWXy$ # #@222h \Z[ G21#6FFGs6T$S8-T$7T$<T T$T-T$5TT$ TFT$(T$AT$$HT$8 T !T$$ U6U6U6U11U6cfa]tRtRtoRtRtRtRtRtRt V3RlR lt R t V3R lR lt R t VtR#)ProcessAllocatori6zDynamic process budget based on CPU count and available RAM. Uses processes (not threads) for CPU-bound work so each worker gets its own Python interpreter and GIL. g?rErgc^RIpVP4;'g^VnVP4wVnVnVP VPRR7VnVP VPRR7Vn R#)r Nrf) max_cpu_fracr2) multiprocessing cpu_countn_cpus _read_ram ram_total_gb ram_avail_gb_calcRAM_PER_TRAIN_GBrRAM_PER_FEATURE_GB feature_procs)r_mps& rrProcessAllocator.__init__?sg%mmo** /3~~/?,4,"jj)>)>sjS"jj)@)@sjSrc\R4;_uu_4p\RVP4P444pRRR4\ XR,P 4^,4R, R, p\ VR,P 4^,4R, R, pW43# +'giL};i \ dRu#i;i)rfc3V"TFpRV9gK VPR4xK! R#5ir r r s& rr-ProcessAllocator._read_ram..Is%S0F1#QR(,!''#,,0Fr Nr rr )rQrg)r.r6rir rrrX)rrr ravails& rr ProcessAllocator._read_ramFs o&&"S 0D0D0FSS':,,.q12=DE>*002156=DE<  '&  O s)C /B9A4C 9 C C CCc,<V^8dQhRS[RS[RS[/#)r7 ram_per_procr r8r )r;rs"rr<ProcessAllocator.__annotate__Ps"  % u  rc*\^\VP^, V,44p\^\VPVP, V, 44p\^\ W4^44p\ e\ V\ 4#V#r)rrr r RAM_HEADROOM_GBrr)rr r usable_cpu usable_ramrs&&& rr ProcessAllocator._calcPsyCqL @AB C   !5!5 5 E  1c*"56  &t_- - rcVP4wqnVPVPR4VnVPVP R4VnR#)rfr2N)r r r r rr r )rr>s& rr"ProcessAllocator.refresh_avail_ram[sF#~~/ "jj)>)>#F"jj)@)@#Frc <V^8dQhRS[/#r6r9)r;rs"rr<r `s   rc RVP RVPR RVPR RVP RVP 2 #)zProcessAllocator | cpus=rrr] z GB avail | training_procs=z | feature_procs=)r r r rr r4s&rrProcessAllocator.status`sZ&t{{m4$$S)0A0A#/FG"1122CDDVDVCW Y r)r r r r rN)rrrrr r r r rr r rrrrrs@rr r 6sBOT  G   rr )r ca]tRtRtoR!V3RlRlltV3RlRltRtRtR tV3R lR lt V3R lR lt Rt V3RlRlt V3RlRlt RtRtRtRtRtRtRtRtRtRtRtRtRtR tVtR#)" TradingSystemipNc,<V^8dQhRS[RS[RS[/#)r7r active_sources trading_mode)rrr:)r;rs"rr<TradingSystem.__annotate__qs#/(/(T/(3/(]`/(rc WnT;'gR0Vn\VnW0nVR9VnVR9Vn\4Vn\4Vn \Uu/uFqDR,\VR,V4bK upVn \Uu.uF1p\W@PVR,,VP4NK3 upVnRRRRRRRRR R R R /p\WPP\!44VnR Vn^Vn^2Vn\+VP,4VnRVnR VnRVnR VnR VnR VnVP=4VnR Vn R Vn!VPE4p\FPH!\J4PMR4pVPOR4V8HVn(VPOR4V8HVn)VPP'd\TPWRV R24VPR'd\TPWRV R24R Vn,R Vn-R Vn.R#uupiuupi)r% rrrr2rr-r皙?rFrrr rr? r@ z%[TrainGuard] EOD already done today (z ) -- skippingz/[TrainGuard] Weekend train already done today (N)longboth)r|r# r)/r r _healthhealthr allow_longrArr rr AGENT_CONFIGSrrqrrrr{ _last_watcher_checkcyclefeat_rebuild_everyr _retrain_retrain_scheduler_last_chart_hour_last_av_fetch_last_report_slot_last_state_save_initial_train_done_fetch_thread_running_load_train_checkpoint_train_checkpoint_idx_last_train_check_ts_last_weekend_check_ts_load_train_donerrBrrCr@_after_hours_train_done_weekend_train_donerr_last_heartbeat_last_github_push_ts_last_github_backup)rr r r r[ _meta_cfg_done_todays&&&& rrTradingSystem.__init__qs%*,77% **.>>*.??!m!m DQRMqy*QvY"::MR -/ -1$A{{1V9'=tyyI -/ M#3S %5t 13 'y))\^L#& $% $&$? $N$&$'$&$'$) %*"&*&A&A&C"&)!&)#%%'i(11*=(- *(=(G$(- .(AV(K  ' ' ' KK?x}U V  # # # KKI&Q^_ `$'$'!$' IS/s $#I7I c&<V^8dQhRS[RS[/#)r7rr8rJ)r;rs"rr<r sMMSMTMrc tVP'gR#RVP9;'gWP9#)zReturn True if the given data source is enabled. In collect-only mode respects --sources flag. In full trading mode all sources are always active. Tr% )r r )rrs&&r_source_activeTradingSystem._source_actives5    +++LLv9L9L/LLrc \PR+4\PR4\PR\ 24\PR\ 24\PR\ 24\PR\ 24\PR4\PR4\PR4\PR \ R 24\PR \ 24\'d#\'d\PR 4M*\PR 4\PR4\PR+4\4\R4VPP4\R4VP'g\R4VP FpVP"P%4K VP&P%4\R4\)VP VP&VP*4\R4M\PR4\R4VPP-4p\RV R24\PRV R24V^8d.\R4VP/4\R4RVnVPP34p\5VP744p\9VPP:4p\PRVR R\9V4 R V R!24V^d8d\PR"\< R#24\R$4VP?R%4'd&VPP@PC4M\PR&4VPPDPC4\PR'4\R(4\G4\HPC4\R)4\PR*4R#),r z@ML Trading System v8 - Alpaca + Finnhub + Sentiment IntelligencezCPU cores : zBase agents : zClone agents : zTotal agents : z5MetaLearner : trading as 33rd agent ($1,000 capital)z5Retrain : every 15 min during market hours + EODzIData sources : Alpaca WS (all IEX bars) + Finnhub (58/min) + AV + PolygonzCharts : z/ hourly accuracy PNGzTrade CSV : z8Alpaca : keys set, WebSocket will connect on startz?Alpaca : no keys set (ALPACA_API_KEY / ALPACA_SECRET_KEY)zL Sign up free at alpaca.markets to enable ~8,000 symbol streamzstartup baselinezafter load_sectorszbefore model loadz)after model load (32 PKL files in memory)zafter agent state restorez>[COLLECT-ONLY] Agent/model loading SKIPPED -- trading disabledzbefore rebuild_all_featureszafter rebuild_all_features (rzFeatures built for z symbols from existing DB datazbefore _retrainzafter _retrainTzDB: rz quotes across z symbols (+z history DB(s))z>>> First run --- need z quotes/symbol to trade.zbefore Alpaca WS startrz4[COLLECT-ONLY] Alpaca WS: DISABLED by --sources flagz>Sentiment : engine started (news + SEC + reddit + congress)zafter sentiment engine startzfully initializedzReady. z<============================================================)%rrr r r rf rr-r%r'rr2rlr r6r rrrrr r{ rur+ r1 r0rTrrrrrC rrrr r)rr8rr.rrb s& r initializeTradingSystem.initializes H VW on%567 ok]34 ol^45 oj\23 KM KM _a oj\1GHI on%567 >// KKR T NN\ ] NNi j H#$ %&   ( )[[ ! IINN  @ A dii I 0 1 KKX Y./ GG ( ( */s)<= )!,JKL q5 & ' MMO % &'+D $002V]]_%TWW))* d5)?3v;-{4&P_`a 3; KK12C1DD\] ^)*   x ( ( GG   # # % KKN O ! TU/0 $% Jrc \R4VP'dE\4'dVPP 4K>\ P !^4KVR#)z Background thread: Finnhub round-robin polling at 58 calls/min. Supplements Alpaca bars with sub-minute quote confirmation for the active 300-stock universe. Nr)rr2 rr rDrrIr4s&r _fetch_loopTradingSystem._fetch_loops@ " (((((* 1 )rc  \4'd\PR4R#^RIpVPR4FpVR,p\P P V4'gK3\P PV4R,R,pV^28gKi\P!V^R7;_uu_4pVPR4P4pRRR4\PR\P PV4 R V R X 24K VPP!4VPP#4\%VP&VP(VPP*VP,4\PR 4R# +'giL;i \d#p\PR T 24Rp?LRp?ii;i) u During market hours: skipped entirely. Training now happens after market close to avoid competing with Alpaca WebSocket, DB writes, and trading decisions simultaneously. This was the cause of silent crashes — parallel training 32 models on five hundred thousand rows while Alpaca was also writing to SQLite caused thread collisions that killed the process with no Python error logged. RETRAIN_SKIPPED_MARKET_OPENNzdata/trading_data_????????.dbrMrrrzWAL_CHECKPOINT | z | was=z MB | result=zWAL_CHECKPOINT_ERR | $RETRAIN_AFTER_HOURS_FEATURES_REBUILT)rrrrOrTrUrVrrrrfetchonerrrXr rur{r| rrrir{ )r_gr_wal_wal_mb_wcri _wes& rr+ TradingSystem._retrainsl      < =  > ww>?V|77>>$'' ggood3t;tCG|$__S!<<#&;;/O#P#Y#Y#[D=$))/0@0@0E/FG##*)<v?@ $$& ""$T[[$))TWW^^T__U@A=<  >   !6se< = = >s=AG 11G ' G  F9'AG 9 G G G9G44G9c <V^8dQhRS[/#r6rO)r;rs"rr<r s   rc  \PP\4'd\P !\ \44p\VPR^44pVPRR4p\P!\4PR4pW48Xd/\PRV RVPRR4 R 24V#^# \d$p\ P#R T 24R p?^#R p?ii;i) z?v9: Load the last completed agent index for round-robin resume.r_ rr,rz0[CHECKPOINT] Resuming training from agent index z (crashed at r^ r\rzCHECKPOINT_LOAD_ERR | N)rTrUrVTRAIN_CHECKPOINT_FILEr~rr.rr@rrBrrCrrrXrr)rrrCrr^rs& rr3 $TradingSystem._load_train_checkpoints ?ww~~344IId#89:!%% 0!45uuVR( Y/88D=KK"RSVRWWdefejejk{|fAeBBC!DEJ ?  #9!!= > > ?s(CB,C D%DDc&<V^8dQhRS[RS[/#)r7next_idxr^ r )r;rs"rr<r .s ? ?s ?C ?rc d\P!R\P!\4P R4RVRVR\P!\ 4P R4/\\R4^R7R # \d$p\PRT 24R p?R #R p?ii;i) rrr_ r^ saved_atr rrx zCHECKPOINT_SAVE_ERR | N) r~rrrBrrCrr.rW rXrr)rrZ r^ rs&&& r_save_train_checkpoint$TradingSystem._save_train_checkpoint.s ? II(,,y"9"B"B:"N ( .(,,z":"C"CD["\  )3/  ;  ?  #9!!= > > ?sA=B B/ B**B/c\PP\4'd\P!\4R#R# \ dR#i;ir )rTrUrVrW rWrXr4s&r_clear_train_checkpoint%TradingSystem._clear_train_checkpoint9s? ww~~344 /05   s(A A AAc <V^8dQhRS[/#r6r5)r;rs"rr<r @s$rc \PP\4'd$\P !\ \44#/# \d/#i;i)z4Load the persistent one-per-day training guard file.)rTrUrVTRAIN_DONE_FILEr~rr.rXr4s&rr7 TradingSystem._load_train_done@sS ww~~o..yyo!677/     s(A"A A A c <V^8dQhRS[/#)r7ryr9)r;rs"rr<r Is??C?rc \P!\4PR4pVP 4pW#V&\P!\ 4PR4VR&\ P!V\\R4^R7\PRV RV 24R # \d$p\PRT 24R p?R #R p?ii;i) z Write today's date under 'key' (eod_date or weekend_date) to TRAIN_DONE_FILE so that bot restarts on the same calendar day will not re-trigger training. rr r\ rrx z [TrainGuard] u written → zTRAIN_DONE_SAVE_ERR | N)rrBrrCr7 rr~rr.rd rrrXrr)rryr^rurs&& r_save_train_doneTradingSystem._save_train_doneIs  ?LL+44Z@E))+DI'||J7@@AXYD  IIdD#6q A KK-uM%A B ?  #9!!= > > ?sB+B// C:CCc daaaaa\P!4p\P!\4P R4p\ P RV 24\P R\SPP4 R\SP4 RSP 24\R4\ P R4\SPSP .,SPSP"4\%SPSP .,SPSP"4\ P R 4SPP+4p\ P R V R 24SPP-4SPP'g\ P)R 4R #\/RSPPP1444p\P RVR R\SPP4 24\ P R4SPP34pV'g\ P)R4\P!\44P R4pSPP7V4oS'g,\ P)R4SPPo\ P R\/RSP1444R R\S4 R 24\9SPP;4RR7p\V4oSPS,p ^p ^p ^p \<e\<M^p \ P RS RV R\> 24^R I o^R I!oVVVVV3Rlp\ES4Uu.uFKpW,S,WV,S,,^,WV,S,,^,3NKM pp\RV R 24\GV R!7;_uu_4pVUu/uFpVPIVV4VbK pp\KV4EFpVPM4wpppppVeTV ^, p \POR"V R#V 2R$R%7\ POR&V^, R'S R(V R)VR* R+V 2 4MV'dV ^, p VV,^,PQ4\ P R&V^, R'S R(V R,\> R-VV,^,PRR. R/VV,^,PU4R. R#VR* R024M3V ^, p \ P)R&V^, R'S R(V R1VR* R22 4V^,S,pVSn SPWTV'gTMR3V 24\R4V R5V R624EK R R R 4\R74\ P R84\YSPSP"SPP4SP"P[4\ P R94\]SPSP"SPP^SP 4\P!4V, p\ P RV R?VR* R@2 4\P RAV R'S RBV RCV RDVR* R22 4V ^8Xd&SPa4\ P RE4\ P RF4\SPSP .,SPSP"4\%SPSP .,SPSP"4\ P RH4\c4\e4SPgRJ4R # \&d$p\P)RT 24R p?EL*R p?ii;iuupiuupi +'giELo;i \&d&p\POR:T 2R;R%7R p?ELR p?ii;i \&d#p\P)RGT 24R p?LR p?ii;i \&d#p\P)RIT 24R p?LR p?ii;i)Kal v9: LIFETIME LEARNING EOD training. Flow: 1. Write pre-train report 2. Rebuild features (incremental, fast) 3. Save today's feature rows to features/daily/features_YYYYMMDD.pkl.gz 4. Load today's feature file as training dataset 5. For each agent sequentially: a. Check tree_count -- if > DISTILL_THRESHOLD, distill first b. Add DAILY_TRAIN_TREES (50) new trees via init_model c. Checkpoint after each agent 6. Write post-train report Agents never forget. Each day adds knowledge on top of all previous days. Monday's trees are still in the model when it runs on Friday of next year. r zEOD training started at zTRAIN_START | symbols=z | models=z | checkpoint_idx=zEOD train startzWriting pre-train report...zPRE_TRAIN_REPORT_ERR | NzPre-train report written.z Features rebuilt: rBz$ No features -- skipping EOD train.c38"TFp\V4xK R#5ir r)rrs& rr3TradingSystem._after_hours_train..sC)BAQ)Br zTRAIN_DATA_SIZE | total_rows=rr&zSaving today's feature file...zC Daily feature save failed -- using in-memory features as fallbackr?zA Could not load daily file -- falling back to in-memory featuresz Training dataset: c38"TFp\V4xK R#5ir rl rs& rrrm s&N7M!s1vv7Mr z rows across cV^,#r r rms&rro2TradingSystem._after_hours_train..1Q4rrz Training z agents | uJ workers | each worker: train → save → release → next | DAILY_TREES=c <Vwrp\P!4pVP\8dp\P RV^, RS RV RVP R\ R2 4S P P ^ZR7pV'dVPV4RpR p\Vn VPS4pRVn \P!4V, p V'dVP4RVn RVnS P4S P!R 4P#^4WWyV3# \dpRTn TpRp?LRp?ii;i \dL3i;i) u Complete lifecycle for one agent in a worker thread: 1. Train -- builds booster, adds DAILY_TRAIN_TREES trees 2. Save -- writes pkl to disk 3. Null -- drops Python reference to booster 4. Trim -- malloc_trim(0) tells glibc to return freed pages to OS 5. Return -- worker is now free for next agent Peak RAM per worker = ~320MB during step 1. After step 4 that memory is fully returned to OS. N concurrent workers = N × 320MB peak, then drops back to base. rrrz | tree_count=z > z | DISTILLING)rNFr4)rr=rCrrr rrHrh rr rXrrrrkr6r7)jobrCrrr distill_dataerrrrrr5rjn_modelsr training_datas& r_train_save_release=TradingSystem._after_hours_train.._train_save_releases\ # CuB"33 #a%(2dV4""'"2"2!337H6IX $ww;;R;H MM,/CG (9%++m4(,% iikB&G !EM EM JJL  K(44Q7w5 5+ (,% $  s*%#E E! E EE! E/.E/zbefore worker-pool training (z workers)rzTRAIN_AGENT_ERR | rFrrrrz FAILED rzs:  | +z trees | val=r>z | IC=z s | releasedz no data rzFAILED:zafter z released (z done)zworker-pool training completezTraining MetaLearner...zMetaLearner done.zTRAIN_META_ERR | TzEOD training complete: trained, z distilled, failed | s totalzTRAIN_COMPLETE | trained=z | distilled=z | failed=z | elapsed=z+Training checkpoint cleared (full success).zWriting post-train report...zPOST_TRAIN_REPORT_ERR | zPost-train report written.zRESOURCE_GRAPH_SKIP | r? )4rrrBrrCrrrrr rrqr4 rlr1 rr{ rr rXrrur{rTrrrrrQrrrh rjr5rrrrrrrrrr] rrr| rir` r rrh ) rrr= rr total_rowsr today_strordered_models start_idx trained_count failed_countdistilled_count N_WORKERSry rV all_jobsrrt rrrCrrrrv rZ elapsed_totalr5rjrw rx s f @@@@r_after_hours_train TradingSystem._after_hours_trainYs$))+,,z*334KL .wi89$S)9)9%:$;<$++&''9$:T:T9U W "# 12 @  t.? ?$)) T !$++0A"A477DII V  /0 GG ( ( * *1#X67 ""$ww NNA B C)9)9)@)@)BCC +Jq>:477++,- /  45WW002  NN` a LL+44X> ::9E  NN^ _ GG,,M "3&N}7K7K7M&N#Nq"QR-() 3   1 1 3H~&..9   (7'BO  zI;7,- / 6 66 6z /  * H , /8; S! * ' azB()L>B$S) , 1   ( ( * KKE F  23 A  t.? ?$)) T !$++0A"A477DII V  01 ? # %   j)g @  #:1#!> ? ? @n W7 6 6V G   !21#6  F F G4 A  #;A3!? @ @ A  ?  #9!!= > > ?sA:a3Ab)b .b Bb C2b "b 9A9bA:c) d a>a99a>b  b  c*c  c c?c::c? d/ d**d/c \P!4p\P!\4P R4p\ P RV 24VPP4pV'g\ PR4R#\RVP444p\ P RVR R\V4 R \ R 24\VPP!4R R 7p^p^p\#V^4Fwpwr\V nV P'V4p RV nV 'ddV P)4V^, p\ P R V R\V4 RV R\ RV P* RV P,R 2 4MRV nV^, p\P4!R4K \7VP8VP:VPP<4VP:P)4\?VP8VP:VPP@VPB4\P!4V, p \ P RV RV RV R R24\EVP8VPB.,VPVP:4\GVP8VPB.,VPVP:4VPIR!4R# \.dcp RT nT^, p\0P3RT RT 2RR7\ P3R T R\T4 RT RT 24Rp ? ELRp ? ii;i \.d&p \0P3RT 2RR7Rp ? ELRp ? ii;i \.d#p \0PR T 24Rp ? LRp ? ii;i)"aq v9: WEEKEND DEEP TRAIN -- Saturday once per week. Combines Mon-Fri daily feature files into a single weekly dataset. The full-week context makes rolling features (ret_5, ret_10, slope_20, weekly momentum, etc.) far more informative than any single day. Adds WEEKLY_TRAIN_TREES (100) trees per agent -- double a daily update. Agents that ran EOD training all week will end Saturday with an extra 100 trees trained on the week's complete picture. Over 52 weekends per year that's 5,200 additional trees of weekly context on top of the 12,600 from daily updates -- agents develop genuine week-over-week pattern recognition. r zWeekend deep train started at z3Weekend train: no weekly data available -- skippingNc38"TFp\V4xK R#5ir rl rs& rr/TradingSystem._weekend_train..hs?*>Q#a&&*>r z Weekly dataset: rz rows | z symbols | +z trees/agentcV^,#rp r rms&rro.TradingSystem._weekend_train..nrr rrrrrr{ z trees | total=z | val=r>zWEEKEND_TRAIN_ERR | rTrz FAILED: r2zWEEKEND_META_ERR | zWeekend deep train complete: r| r} rr~ zWEEKEND_REPORT_ERR | r@ )%rrrBrrCrrr rrrTrrri rQrqrrrr rr=rrXrrrIrrrrr| rir{ r1 r rh )rrr= weekly_data weekly_rowsr rfailedrrrrrrs& r_weekend_trainTradingSystem._weekend_trainNsU ))+,,z*334KL 4WI>?gg224  NNP Q ?+*<*<*>??   Qx; -?,@  N   1 1 3H ).! < A} R(:%++k2(,%JJLqLGKKaS#n"5!6b?./u?O?O>PQ$}}S13 -1E)aKF JJsO+!=0 I DKKDGG4D4D E IINN  T[[$))TWW^^T__U))+' +G9Jhj W 6  >  t.? ?$)) T !$++0A"A477DII V n-9 R(,%! ""%9$s1##FQU"V s1#Qs>':&;2dV9QCPQQ  R I   !4QC84  H H I >  #8!< = = >sRB L/*L/AN"A:O/ N:ANN O*O  O O?O::O?c 0a\P!4pV\SR^4, R8dR#VSn\P!V3RlRRR7P 4R# \ d$p\PRT 24Rp?R#Rp?ii;i) z#Generate accuracy chart every hour._last_chart_tsrcNcX<\SPSPP4#r )rs rr rhr4srro,TradingSystem._maybe_chart..s6t{{DGGJJOrTChartGenrz CHART_ERR | ) rr}r rrrrXrrrrBrsf r _maybe_chartTradingSystem._maybe_charts|iik /3 3d : ! 5   O* eg 5  <s!3 4 4 5+A'' B2BBc 0a\P!4pV\SR^4, R8dR#VSn\P!V3RlRRR7P 4R# \ d$p\PRT 24Rp?R#Rp?ii;i) z9Write hourly report every 30 minutes during market hours._last_report_tsrbNcZ<\SPSPSP4#r )r rr rr4srro-TradingSystem._maybe_report..s}T[[$''499MrT HourlyReportrz REPORT_ERR | ) rr}r rrrrXrrr sf r _maybe_reportTradingSystem._maybe_reports|iik 0!4 4t ; " 6   M. eg 6  =!4 5 5 6r c \P!4pV\VR^4, R8dR#WnVPP 4R# \ d$p\ PRT 24Rp?R#Rp?ii;i)z/Trigger Alpha Vantage burst fetch periodically. _last_av_tsraNzAV_FETCH_ERR | )rr}r r rGrXrrr s& r_maybe_av_fetchTradingSystem._maybe_av_fetchsiiik }a0 03 6  8 GG - - / 8  ?1#!6 7 7 8sA BA==Bc a\P!4pV\SR^4, R8dR#VSn\P!V3RlRRR7P 4R#)z"Save agent state every 15 minutes._last_state_save_tsrdNc<\SPSPSPPSP 4#r )r| rrr rir{ r4srro1TradingSystem._maybe_save_state..s(/ TYYX\XgXghrT StateSaver)rr}r rrrrUsf r_maybe_save_stateTradingSystem._maybe_save_statesOiik 4a8 83 > #& hk  %'rc VPP4R# \d$p\P RT 24Rp?R#Rp?ii;i)z)Rotate DB if needed -- called each cycle.zWATCHER_CHECK_ERR | N)r rrXrrrs& r_maybe_check_watcher"TradingSystem._maybe_check_watchers@ = GG ( ( * =  #7s!; < < =s A AA c f\P!4p\P!\4pVP 4pV^8pV'dRpM\ 4'dRpMRpV\ VR^4, V8dR#Wn\P!\RRR7P4R#) a] Smart local backup with frequency based on market schedule: - Weekday market hours : every 30 min (new data every minute) - Weekday off-hours : every 2 hours (EOD train done, just protecting state) - Weekend : every 6 hours (no new data, just safety net) Renamed from _maybe_github_backup (misleading -- this is local-only). r" rbi _last_backup_tsNT LocalBackupr) rrrBrrrr}r rrrr)rrBnow_etr is_weekendrs& r_maybe_local_backup!TradingSystem._maybe_local_backupsi(!AX H   HH 0!4 4x ? "d %'rc \P!4pV\VR^4, R8dR#Wn\P!VP RRR7P 4R#)a Push key report files to GitHub Stock_Bot/backup/ once per day. This allows remote review of bot state without SSH access. Files pushed: human_report.txt, claude_handoff.json, TRADE_LOG.csv, agent_state.json, train_done.json, last 500 lines of trading.log r; reNT GithubPushr)rr}r; rr_do_github_pushrrUs& r_maybe_github_push TradingSystem._maybe_github_pushsQiik 5q9 9E A $'!''< %'rc  aaaaaa^RIo^RIo^RIo\^4RoRpRV R2oRRS 2RR /oR VVVVVV3R llp\P !\ 4PR 4p^p.R%OpVFxwrg\PPV4'gK,\VR 4P4p\V4R&8dKYV!WxRV 24p V 'd V^, pKxKz \PPR4'dg\RR4;_uu_4p V P#4p RRR4RP%X R'R4P'4p V!RV RV 24V^, p^RIp.p\+VP)\PP%\,R444Fhp\P.!V4pVP1R\PP3V4RVP4R,RVP6/4Kj SP9RVR\V4RV/^R7P'4pV!RVR V 24V^, p\:P=R"V R#24\P=R$V 24R# \d(p \P!RT RT 24Rp ? EK\Rp ? ii;i +'giEL;i \d$p \P!RT 24Rp ? ELRp ? ii;i \d#p\P!R!T 24Rp?LRp?ii;i)(z(Upload key files to GitHub via REST API.N]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zJake-Culberson/Claud-Codezhttps://api.github.com/repos/z /contents AuthorizationBearer z Content-Typezapplication/jsonc<V^8dQhR\R\R\/#)r7 remote_path content_bytesr)r:bytes)r;s"rr<3TradingSystem._do_github_push..__annotate__ s!  s 5 s rc<S RV 2pSPPVRRS 2/R7pRpSPPV4;_uu_4pS PVP 44P RR4pRRR4RTRS PT4P4/pT'dYWR&SPPTS PT4P4R SR 7pSPPT4;_uu_4pS PTP 44P R /4P RR4R ,uuRRR4# +'giL;i \ dELi;i +'giR#;i \ d'p \PR T RT 24Rp ? R#Rp ? ii;i)rr r )rqr,shaNrcontentPUT)rumethodrqrrzGITHUB_PUSH_ERR | r) requestRequesturlopenrrir@rX b64encodedecoderencoderr)r r rrreqr rpayloadreq2rAPIPAT_jsonrd hdrsurllibs&&& r_push,TradingSystem._do_github_push.._push sE;-(C..(('RUQV6X(YCC ^^++C00D++diik266ubAC1!#y&2B2B=2Q2X2X2Z[G!$>>))#EKK4H4O4O4Q27*GD ^^++D11T ;;tyy{377"EII%QSTUXY2110  211 $$'9+c!%MN sf#E<0E)E<5#F"AF F") E9 4E<9E<< F  F  F F"F"" G-GGrrbrzbot: daily push zGITHUB_PUSH_FILE_ERR | rrrr,z%Stock_Bot/backup/trading_log_tail.txtzGITHUB_PUSH_LOG_ERR | z*.pklrsize_kbmtime generatedrrqrx z$Stock_Bot/backup/model_manifest.jsonzbot: model manifest zGITHUB_MANIFEST_ERR | zGitHub daily push complete: u files → Stock_Bot/backup/zGITHUB_PUSH_COMPLETE | files=) rz!Stock_Bot/backup/human_report.txtrz$Stock_Bot/backup/claude_handoff.jsonrnzStock_Bot/backup/TRADE_LOG.csv)rrz!Stock_Bot/backup/agent_state.json)rpz Stock_Bot/backup/train_done.json)roz&Stock_Bot/backup/train_checkpoint.json)rz#Stock_Bot/backup/bot_dashboard.htmlr r r i@i )urllib.requestrd r~rrrBrrCrTrUrVr.rirrXrr readlinesrr rOrQrstatrSrst_sizest_mtimerrr)rREPOr r= pushed files_to_pushrremoter r rrr rM_glmanifest_pkl_stmanifest_bytes_mer r r rd r r s& @@@@@@rr TradingSystem._do_github_pushs44" n*.tfI>73%.BTU  ,,,z*334HI  +ME77>>%(( Nud+002w<"22F/?y-IJaKF+ 77>>- ( ( C---KKME.wwuTU|,335=tGWX_W`Eab!  A Hsxx ^W(MNOggdmBGG,,T2s{{d2S\\!P#[[WX(* )   8.( 2 4 aKF  26(:VWX9&BCO N$$'>ugS%LMM N .--  C$$'=aS%ABB C0 A  #9#!? @ @ Ash*J JK(&K7AK(8C4L K*K  K K%  K(( L3LL M$MMc \^4VPP4R# \d&p\P RT 2RR7Rp?R#Rp?ii;i)z9Background feature rebuild -- runs in FeatRebuild thread.zFEAT_REBUILD_BG_ERR | TrN)rr rurXrrrs& r_rebuild_features_background*TradingSystem._rebuild_features_backgroundbsO L aL GG ( ( * L   !7s;d  K K Ls%) AAAc  VPPp\VPP4pVPF%pVP V4VP V4K' .p.pVP4FwrgVe\V4\8dKVPVR4pV^8:dK:V\,PR,P\P4p \P !\P"!V 44'gKTP'T4TP'T 4K V'gR#\P(!V\PR7p VP*P-V 4p \P1R4p VPEFpVP4P6'gK"\9VP4R4'dJ\VP4P:4^8d&VP4P=4\>8dKVP4P-V 4wr\GT4EFwppTPTR4pT^8:dK"\IT T,4p\KTT,4p\KT T,4pTR ,TR ,,pTTPL8dKT ^8d\KTT,T ,4MR pT^8XdYcPN9dTPQYhR R 7KYcPR9d_TPT'dJTP4PWTT,4wpppTPYYhT;'gRTTTT4EK;EK>EKAT^8XgEKKYcPR9dTP[YhR R 7EKqYcPN9gEKTP\'gEKTP4PWTT,4wpppTP_YhT;'gRTTT4EK EK VP`P4P6'EdVP`P V4VP`P V4VP`P4P-V 4wpp\GV4EFOwppVPVR4pV^8:dK"\IVV,4p\KVV,4pVR ,R,pV ^8d\KVV,V ,4MR pV^8XdVVP`PL8dW`P`PN9d VP`PQWhR R 7KW`P`PR9dsVPT'd^VP`P4PWVV,4wpppVP`PYYhT;'gRVRVV4EK\EK_EKbV^8XgEKlVVP`PL8gEKW`P`PR9d!VP`P[WhR R 7EKW`P`PN9gEKVP\'gEKVP`P4PWVV,4wpppVP`P_YhT;'gRVRV4EKR \@PcR\V4 RVPd 24R# \$dEKi;i \$d5\P.!\T4R\PR7p EL i;i \2dRp ELi;i \$d2p\@PCRTPD RT 24Rp?EKMRp?ii;i \$d$p\@PCRT 24Rp?ELRp?ii;i)u v9: Core trading loop — runs every ~1 second during market hours. Flow: 1. Exit checks on all agents (ATR stop-loss, take-profit, drawdown reset) 2. Build tradeable symbol list + stacked feature matrix 3. Per-agent: batch-predict all symbols in one LGB call 4. Signals passing IC gate + min_conf: execute buy/sell/short/cover Uses predict_batch() so each agent makes ONE LightGBM call per cycle. Full predict() only called at actual trade execution to get pred_pct. Nr rzr2rDrzBATCH_PREDICT_ERR | rrDrErr)r(zMETA_AGENT_TRADE_ERR | zTRADING_PASS | syms= | cycle=rr/)3r rir6rrrrrrrr@rrrrr}r% isfiniterXrSrrrqr~rarrrrrrrIrrrrrrr rrr r& r rerurAr|r{ rr) )rrirrsymsvecsrrrvecrg meta_batchatr_idx directions confidences_perrrbrJrsrDr>pred_pct meta_dirsmeta_cfsrmcfeff_mpes& r _trading_passTradingSystem._trading_passjsP77>>(()++B NN6 " NN6 " ~~'GCzSW'88JJsC(Ez &--b188Dvvbkk#.//0 KK  KK ( hht2::6  C00=J  "((3G ++B88###,//++,1HH''),AA *,((*@*@*M' $D/3 3,A:jm, A/ 1 .s(Ws]2BKK'5<\%Q 01t6000H=LL0T___)+)9)9$q')B8Qs8??sBQXY6E0!Vll*8<$6$664;K;K;K)+)9)9$q')B8QX__b'6R7*#^ ?? ( ( ( OO ' ' / OO ' ' / G&*oo&;&;&I&I+&V# 8'oFAs"JJsC0Ez8il+B ,C)i/C9@AeDGG$454GQw3$//*B*B#B//"A"AA OO11#X1N (A(AAdooo-1__-B-B-J-J4PQ7-SNAx OO//HOOSRUWZ\cdGVAqSDOO,D,D%D//";";; OO00H0M (G(GGDL\L\L\-1__-B-B-J-J4PQ7-SNAx OO11#hoo#sTWY\]%., "3t9+.ZZL " C   CTCrzzBJ C  G " $$';BGG9Cu%MN t G$$'>tf%EFF Gs:A+])?]<^>_2D1`$A`3``/A``A`*`) ]98]9<;^;:^;> __ `%`  ` `?`::`?cVP4'gR#VP'dVP4R#\P R4\ P R4RpRVn\P!VPRRR7pVP4\P R4\ P R4\4p\P!\4p\P!4VP , R 8d\P!4Vn\P"!4Uu.uFqUP$NK pp\'VP(P*P,P/44p\ P R V R VP0 R VP(P2P54R R\'VP(P64 RV RV 2 4V'dV'g\P R4\ P R4RVnVP;4pVP=RR4\>P@!V\C\DR4^R7VP(PI4TpV'Ed6V;P0^, unVP0VPJ,^8Xdx\MR\P"!444p V ^8Xd3\P!VPNRRR7P4M\ PQRV R24\P!4p VP(P6'dVPS4VPU4VPW4VPY4VP[4VP]4VP_4VPa4\P!4V , p V R8d\ PcRV R RVP0 R\'VP(P64 R\MR VPd44 R!\fPh R"\fPj 2 4\Pl!\o^R#V , 44EK%\P!4p WPp, R 8p V 'Ed;VP8'Eg(VPs4^8EdWn8VPtVPvrV^8;'gV^8H;'dV^8pV^8;'gV^8H;'dV^8*pT;'gTpV'dRVn\P R$VPyR%4 R&V'dR'MR( R)24\ P R*V'dR+MR, R-VPyR%4 R.24\P!VPzRR/R7P4VPs4R>9pT;'d!^VPtu;8*;'d^8*Mup\P!4VP|, R 8pV'dVP~'gV'd{\P!4Vn>RVn?\P R0VPyR14 R.24\P!VPRR2R7P4VPs4^8XddVP~'dRRVn?VP;4pVP=R3R4\>P@!V\C\DR4^R7VP_4VPa4\4p\V4R4,^8d"\P R5VR4, R R624\Pl!^4EKuupi \FdELi;i \FdLi;i \Edo\P R74\ P R84RTnTP(P2P4TP(P*P4TPdFpTPP4K TPP4\TPdTPTP(PTP4\TPdTP(TP4\TPdTP(P,4\P R94R#\Fdmp\PR:T 2RR;7\ PR<\T4P R=T 2RR;7\Pl!^4Rp?E KRp?ii;i)?Nz#Main loop running. Ctrl+C to stop. MAIN_LOOP_STARTFT FinnhubFetchrz8Finnhub fetch thread started (58 calls/min round-robin).FINNHUB_THREAD_STARTEDrazHEARTBEAT | market_open=r rrz | features=z | sentiment_symbols=z | threads=zMarket just opened. MARKET_OPENr? rrx c3|"TF2pVPR8XgKVP4'gK.^xK4 R#5i) FeatRebuildN)ris_alive)rrRs& rr$TradingSystem.run..1s3/'(>'?@$$3$<$<#= ?JJs1cO&;<= #iikG"),E,E"E#!MJ!z$*F*F*F6>>K[^_K_4;1!'fmmB(*R'K'KR2X5J5J"( (*Q'I'IB!G4H4Hb '2'A'Ak %;?D8"KK"89Q8RRX3>'>',%6$eg &,^^%5%?K$/$J$JA4J4J4JK%)YY[43N3N%NSV$VM"4+C+C+C 6:iik3370 :%z:;3@"((#'#6#6#(!/ %'~~'1,1I1I1I380/!%!6!6!8BFF>48 IIb$*DQO,,.++--/D4y4'", &7T #m$TUJJrNg&M,%*d*l ).$.%  01!!"?@-2*!!&&(!!&&(AGGLLN%  $T[[$))TWW^^T__]dkk477DII>' TWWZZ@ 89  |A3/$ ?"",T!W-=-=,>bD!# 1  sBa<a#B1a<a<1a<A a$a<=C"a< Ea<2Aa<8A a<a< a<#a<2 a<=0a<."a<A)a<;a<8a< a<a<'B a<a<A a+A8a<a< a($a<'a((a<+ a96a<8a99a<i+?A i&&i+)"r8 r2 r1 r. r r r- r r< r; r: r/ r r0 r r5 r( r6 r, r4 r9 r rr& rAr r) r r* r% rr{ rqr )FNr" )rrrrrrC rF rI r+ r3 r] r` r7 rh r r r r r r r r r r r r r- rrrs@rr r ps/(/(bMMBH !BF   ? ??? s*jP.f 5 6 8 =2 ^D@LH TCCrr __main__z[v9] uvloop installedzStockTrading.pyz7ML Stock Trading Bot v8 -- Alpaca + Finnhub + SentimentaExamples: python3 StockTrading.py # full trading mode python3 StockTrading.py --collect-only # all sources, no trading python3 StockTrading.py --collect-only --sources alpaca python3 StockTrading.py --collect-only --sources alpaca,finnhub python3 StockTrading.py --collect-only --sources alpaca,finnhub,news,sec python3 StockTrading.py --collect-only --sources all Valid source names: alpaca finnhub news sec stocktwits reddit congress all)prog descriptionformatter_classepilogz--collect-only store_truezoRun data collection pipelines only. No agents loaded, no trading. Use to test/debug data sources independently.)rwrJ helpz --sourcesz SRC[,SRC,...]zComma-separated sources to enable (only relevant with --collect-only). Options: alpaca finnhub news sec stocktwits reddit congress all. Default: all)rJ metavarr5 z--moder" r|r# zmTrading direction mode. long=buy/sell only (default), short=short/cover only, both=full bidirectional trading)rJ choicesr5 z --ram-capr zHard RAM ceiling in GB. Bot will never allocate beyond this. If not specified, runs uncapped at max efficiency. Example: --ram-cap 6.0 sets a 6 GB ceiling on a 7.3 GB VM.)rrJ r6 r5 z --max-workersNzHard cap on concurrent threads/workers across feature rebuild, training, and all ThreadPoolExecutor usage. If not specified, the bot auto-scales to CPU count (max efficiency). Example: --max-workers 4 limits to 4 concurrent threads on any VM.rz[ERROR] Unknown sources: z Valid options : rz[RAM CAP] Hard ceiling: rrb z" MB) | ResourceGuard throttle at: z MB | pause at: r z MBz/[RAM CAP] Uncapped -- running at max efficiencyz[MAX WORKERS] Hard cap: zO concurrent threads | Applies to: feature rebuild, training, ThreadPoolExecutorz2[MAX WORKERS] Uncapped -- auto-scales to CPU countz- [COLLECT-ONLY] Starting data collection modez[COLLECT-ONLY] Sources : rz"[COLLECT-ONLY] Trading : DISABLEDz&[COLLECT-ONLY] Log file : trading.log z( [ERROR] Set your Finnhub API key first!z' export FINNHUB_API_KEY=your_key_here z [MODE] Trading mode: z.[MODE] Short selling ONLY -- no long positionsz0[MODE] Bidirectional -- longs AND shorts enabledz/[MODE] Long only -- standard buy/sell (default))r r r )rr-)rB r)rr)r2r3)rr4)wallstreetbetsstocks investing StockMarket) restatement resignation terminationrJ bankruptcyfraud investigationlawsuit delistingz going concernzmaterial weaknesszcybersecurity incidentz data breachzregulatory actionzsec investigation) acquisitionmergerzstrategic partnershipz new contractbuybackzdividend increasezguidance raisedzrecord revenuez fda approvalzpatent granted expansion)r r ->rtrrrrrrsrrurrrrqrrrr}rrwrvrzrxr|r{ryr~)) UltraConservrB Q?rDrf) Conservativer0 ףp= ?gQ?r )ModerateDefensr.rg)\(?r)ModeraterN r/rr) MeanReversionrL )\(?rr3)MomentumrR ףp= ?g= ףp=?rh) ModerateAggrrr-gQ?rL) AggressiveQ?gq= ףp?r! g?)HighConvictionr1rEg(\?rg) ContrarianrrW gzG?r ) Volatilityp= ף?g(\?g(\?r) UltraAggressrT gQ?g(\?g333333?)SectorRotationrN r-Q?r)LowFreqrL r1gq= ףp?g?)HighFreqrg)\(?gHzG?rf)Balancedrr[ r^ r)r)NNr >r% rrrrr7rr)r" r|r# ((r rTrrloggingrrr r~rNr/hashlibxml.etree.ElementTreeetree ElementTreeETrr collectionsrrr rrpandasrr7rr rr* r r r r matplotlib.gridspecr+ rrr printvaderSentiment.vaderSentimentrr'rTr.rrlightgbmrruvloop UVLOOP_OKconcurrent.futuresrrsklearn.ensemblerrsklearn.preprocessingr sklearn.model_selectionr!sklearn.metricsr"r r rrr r rf environr@r#r%r'r)r+r rrrrrrr{rbrrr0rrr/rArPrDr_rrrrh ri rCrj rr@rhrrSENTIMENT_LOOKBACK_NEWSrSENTIMENT_LOOKBACK_SECrXrSENTIMENT_WEIGHT_NEWSSENTIMENT_WEIGHT_SECSENTIMENT_WEIGHT_REDDITSENTIMENT_WEIGHT_CONGRESSrirjrrkrr SEC_EDGAR_RSSSEC_EDGAR_SEARCHrrSr{r|rrr-rW rd rhrrrrz rrrIrr rrRETRAIN_MINUTESrHrr rrr Formatterrr _main_fmt _debug_fmt basicConfigINFO getLoggerrrsetLevel FileHandler_fh_main setFormatter StreamHandler_sh_main addHandler propagater _rhrRrBrC_debug_session_filerDEBUGrr _dh_dh2rr?r2rBSTOCK_UNIVERSE_PRIMARYrGr6fromkeysrr5rrrr' rrrrr:rfrrrrrlrrr!rrrrrrrrrrrrrs r| r r r r1 r r r r r r$ COLLECT_ONLY_REPORT_INTERVAL VALID_SOURCESr' r$ rh r r r r r r r r rr rRESOURCE_GUARD_RAM_WARNRESOURCE_GUARD_RAM_BAILr rlr r r rf r r rrrr installargparse_apArgumentParserRawDescriptionHelpFormatterr add_argumentrr parse_args_argssourcesrrrbr_badrQr<sys_sysmodules _this_modram_caprr rrrer- rO s0rr s ENLKKKK++(*  u&PM HHM  E I FI @R04* !**,QNB/0  |+ JJNN#46`aJJNN#38TUJJNN#68fgJJNN#68JKJJNN=;  "" "")F, ''/"! "#!#!   zz~~&8bAzz~~&  :z66 ! ',,4   8 $    } -i  "i ((!!(+ w||$ /*  %,, a ''89 >@  ) gmm$  .s3  .S9*  .." O>1 1 111$1%+1,112617=1>D1 1 11 1!&1',1-21391:?1@F1 1  1 1 1% 1&, 1-3 149 1:@ 1AG 1  1  1  1 ! 1 "( 1 )/ 1 1 111 1!$1%(1)-1.31491:?1@D1 1 111#1$)1*/10617<1=A1BH1 1 111$1%*1+112819>1?D1 1 11 1 111#1$)1*/10516;1C)1* +1* +1*+1*+1* +1*!&+1*',+1*-3+1*49+1*:?+1*@E+1, -1, -1,-1,-1,$-1,%*-1,+0-1,16-1,7=-1,>C-10 110 110110110!110"(110).110/2110381109>110?D112 312 312312312!312"'312(.312/53126;312918?C91: ;1: ;1:;1:;1:!;1:"';1:(-;1:.4;1:5;;1:=1<?D=1> ?1> ?1>?1>?1B C1B C1BC1BC1B"C1B#(C1B).C1B/3C1B49C1B:@C1BAEC1D E1D E1DE1DE1D!E1D"'E1D(-E1D.3E1D49E1D:>E1D?DE1F G1F G1FG1J K1J K1JK1JK1J#K1J$)K1J*/K1J05K1J6;K1JS1R?ES1V W1V W1VW1VW1V"W1V#)W1V*0W1V17W1V8>W1V?DW1X Y1X Y1\ ]1\ ]1\]1\]1\"]1^ _1^ _1^_1^_1^"_1^#(_1^)._1^/4_1^5;_1^ ?2BC2DE2FG2HI2JK2LM2NO2PQ2RS2RS2TU2T$U2VW2V"W2Z[2\]2^_2`a2b c2 f  K'K'N ppf~#~#R  k  k  bWWt 9-*9-~ -/-/f 1 1==(BB&L L d &bXl3h < <;;4P;fD_A_ADS:n{@|^;H  .8 "X __B   k/ZAJ   IWSWS~")**NGb/ / b q#na01n5GGV" z %&   M77 b  BOO$\5=>OOK]^OOHf)/0 OOKeT4JKOOO#tSRS MMOE',}}':':3'? @'?!GGIOO '? @D - D t )$01 )&*?)@AB Q   4<< +CDI }} "5==4#78  &u}}S&9y?S?STU>VW**-i.B.B4.G*H)KLY11$67:# ? $  ?@ $$'5+<+<$= ! &y'@'@&ABH I %) ! BC  >@ *499VD\+B*CDE 24 79  9: 89 Q     ' (8(8(:';<= :: B C ZZ6 ! D E C D u11$$zz++.35AujPM WX NOP%%H JM EI C F GHI FI~j AsAAAA1AB AB%AB-,AC,(ACAAA.A-AA.A1ABBABB ABBABB AB*B)AB*B-ACCACC ACCAC