?i$FdZddlZddlZddlZddlmZmZmZmZddl m Z m Z ddgZ de fd Zde fd Zd e j d efd ZdZdZdZde d eee effdZde d eee effdZde d ee effdZddddZdZde d e fdZde d e fdZde de d e d!e d ee eff d"Z d2d#e de de d$e d%e d&e d!e d'ee d(eed)ed ee effd*Z d3d+ee de d$e d%e d,ed eee eff d-Z d.e d e fd/Z!d0ee efd eee effd1Z"y)4z1OpenAI Responses API client for Reddit discovery.N)AnyDictListOptional)httpenvzgpt-4.1zgpt-4omsgctjjd|dtjjy)zLog error to stderr.z[REDDIT ERROR]  Nsysstderrwriteflushr s X/home/ubuntu/.openclaw/workspace/skills/last30days-official/scripts/lib/openai_reddit.py _log_errorrs-JJse2./JJctjjd|dtjjy)zLog info to stderr.z [REDDIT] r Nr rs r _log_infors-JJyR()JJrerrorreturnc|jdvry|jsy|jjtfddDS)z:Check if error is due to model access/verification issues.)iFc3&K|]}|v yw)N).0phrase body_lowers r z)_is_model_access_error..#sv#s)verifiedzorganization must bezdoes not have accessz not availablez not found) status_codebodylowerany)rr s @r_is_model_access_errorr'sL  * ::!!#J 3 rz#https://api.openai.com/v1/responsesz/https://chatgpt.com/backend-api/codex/responsesaYou are a research assistant for a skill that summarizes what people are discussing in the last 30 days. Your goal is to find relevant Reddit threads about the topic and return ONLY the required JSON. Be inclusive (return more rather than fewer), but avoid irrelevant results. Prefer threads with discussion and comments. If you can infer a date, include it; otherwise use null. Do not include developers.reddit.com or business.reddit.com.chunkcP|jd}g}|D]6}|jds|j|ddj8|sydj |j}|r|dk(ry t j |S#t j$rYywxYw)z,Parse a single SSE chunk into a JSON object.r zdata:Nz[DONE])split startswithappendstripjoinjsonloadsJSONDecodeError)r(lines data_lineslinedatas r_parse_sse_chunkr78s KK EJ0 ??7 #   d12hnn. /0  99Z & & (D 48#zz$   s:BB%$B%rawcg}d}|jdD]D}||z }d|vs |jdd\}}t|}||j|d|vr8F|j rt|}||j||S)z6Parse SSE stream from raw text and return JSON events.T)keepends r) splitlinesr+r7r-r.)r8eventsbufferr( event_chunkevents r_parse_sse_stream_rawrBNs#%F F.%%"(,,vq"9 K$[1E  e$ %||~ (   MM% Mrc t|}t|D]s}t|ts|j ddk(r&t|j dtr|dcSt|j dtsn|dcSd}|D]a}t|ts|j d}t|t r||z };|j d}t|t s]||z }c|r ddd |d gd giSiS) z@Parse SSE stream from Codex responses into a response-like dict.typezresponse.completedresponser:deltatextoutputmessage output_textrDrG)rDcontent)rBreversed isinstancedictgetstr)r8r>evtrJrFrGs r_parse_codex_streamrS`s "3 'F' c4 wwv"66:cggjFY[_;`:&#''*-t4:& 'K  #t$   eS ! 5 K wwv dC 4 K   %)6 LM   Ir))2)Fd)quickdefaultdeepuFind Reddit discussion threads about: {topic} STEP 1: EXTRACT THE CORE SUBJECT Get the MAIN NOUN/PRODUCT/TOPIC: - "best nano banana prompting practices" → "nano banana" - "killer features of clawdbot" → "clawdbot" - "top Claude Code skills" → "Claude Code" DO NOT include "best", "top", "tips", "practices", "features" in your search. STEP 2: SEARCH BROADLY Search for the core subject: 1. "[core subject] site:reddit.com" 2. "reddit [core subject]" 3. "[core subject] reddit" Return as many relevant threads as you find. We filter by date server-side. STEP 3: INCLUDE ALL MATCHES - Include ALL threads about the core subject - Set date to "YYYY-MM-DD" if you can determine it, otherwise null - We verify dates and filter old content server-side - DO NOT pre-filter aggressively - include anything relevant REQUIRED: URLs must contain "/r/" AND "/comments/" REJECT: developers.reddit.com, business.reddit.com Find {min_items}-{max_items} threads. Return MORE rather than fewer. Return JSON: {{ "items": [ {{ "title": "Thread title", "url": "https://www.reddit.com/r/sub/comments/xyz/title/", "subreddit": "subreddit_name", "date": "YYYY-MM-DD or null", "why_relevant": "Why relevant", "relevance": 0.85 }} ] }}topiccgd}|jj}|Dcgc] }||vs| }}dj|ddxs|Scc}w)z2Extract core subject from verbose query for retry.)besttopzhow toztips for practicesfeatureskillerguidetutorialrecommendationsadvice promptingusingforwiththeofinon N)r%r+r/)r]noisewordswresults r_extract_core_subjectrvsX KE KKM   !E 1A!5.a 1F 1 88F2AJ  (5(2s AAct|}|jddjddj}d|dS)zBuild a subreddit-targeted search query for fallback. When standard search returns few results, try searching for the subreddit itself: 'r/kanye', 'r/howie', etc. .r:rpr/z site:reddit.com)rvreplacer%)r]coresub_names r_build_subreddit_queryr}sD ! 'D||C$,,S"5;;=H z) **rmodelinstructions_text input_text auth_sourcect|ddddgidgdg||d}|tjk(rdd d |d gd g|d <d|d<|S)z6Build responses payload for OpenAI or Codex endpoints.F web_searchallowed_domains reddit.comrDfiltersweb_search_call.action.sources)r~storetoolsinclude instructionsinputrIuserrrK)rDrolerLrTstream)r AUTH_SOURCE_CODEX)r~rrrpayloads r_build_payloadrs%% ~  55)Gc+++"%1:FG  ! Nrapi_key from_dateto_datedepth account_id mock_response_retryc ||Stj|td\} } |tjk(r|s t dd||dddd} t } nd|dd } t } |d k(rd n|dk(rd nd }|gtDcgc] }||k7s | c}z}tj|||| | }|tjk(rddl m }|g|jDcgc] }||k7s | c}z}tdz|z}d}|D]:} t||||}tj | || |}t#|xsdcS|r|tj$dd}|D],}|dddgidgdg|d} tj*| || |cS|rt/d"||tj$d#cc}wcc}w#tj$$r+}|}|j&dk(rt)d|dYd}~d}~wwxYw#tj$$rJ}|}t-|rt)d|dYd}~|j&dk(rt)d |d!Yd}~d}~wwxYw)$aSearch Reddit for relevant threads using OpenAI Responses API. Args: api_key: OpenAI API key model: Model to use topic: Search topic from_date: Start date (YYYY-MM-DD) - only include threads after this to_date: End date (YYYY-MM-DD) - only include threads before this depth: Research depth - "quick", "default", or "deep" mock_response: Mock response for testing Returns: Raw API response Nr[z)Missing chatgpt_account_id for Codex authzBearer zresponses=experimentalpiapplication/json) Authorizationzchatgpt-account-idz OpenAI-Beta originator Content-Type)rrrZZx)r]rr min_items max_itemsr)modelsr<)headerstimeoutr:rzModel z+ not supported on Codex, trying fallback...z$No Codex-compatible models availablerrrrr)r~rrrz# not accessible, trying fallback...zRate limited on z, trying fallback model...zAll models failed. Last error: zNo models available) DEPTH_CONFIGrPr r ValueErrorCODEX_RESPONSES_URLOPENAI_RESPONSES_URLMODEL_FALLBACK_ORDERREDDIT_SEARCH_PROMPTformatr:rCODEX_FALLBACK_MODELSCODEX_INSTRUCTIONSrrpost_rawrS HTTPErrorr#rpostr'r)rr~r]rrrrrrrrrrurlrm models_to_tryr models_modcodex_models_to_tryr last_error current_modelrr8es r search_redditrs4 '++E< 3JKIyc+++HI I&wi0",3.  " 'wi0. #W$b)1C#GG*>MQ!u*qMMM&,, -Jc+++*$gJ4T4T(cqXY]bXb(cc.7*D 0 M (8I5R]^mmC'7S*39"55   nnCDDJ& "))L> 99   99S'7GL L!:4ZLAB ... //GN)d>>  ==C'}o5`ab  :~~ J%a(F=/1TUV}}#,]O;UVW  sZ? F* F* F/!F/>5F4'G54G2 G-,G--G25II )I  I  I subreddits count_perc g}t|}|D]}}|jd} d|d}dt|d|d} |d| } tjdd } tj | | d d } | j d ij dg} t | D]\}}|j ddk7r|j d i}|j dd}|sBdt|d zt|j ddjd|t|j d|jdd|ddd}|j d}|rd dl m }|j||d<|j||S#tj$r=}td|d ||j d!k(rtd"Yd}~|SYd}~d}~wt"$r}td#|d |Yd}~d}~wwxYw)$a Search specific subreddits via Reddit's free JSON endpoint. No API key needed. Uses reddit.com/r/{sub}/search/.json endpoint. Used in Phase 2 supplemental search after entity extraction. Args: subreddits: List of subreddit names (without r/) topic: Search topic from_date: Start date (YYYY-MM-DD) to_date: End date (YYYY-MM-DD) count_per: Results to request per subreddit Returns: List of raw item dicts (same format as parse_reddit_response output). ryzhttps://www.reddit.com/r/z /search/.jsonzq=z&restrict_sr=on&sort=new&limit=z &raw_json=1?r)z User-AgentAcceptrTr)rrretriesr6childrenkindt3 permalinkr:RStitlezhttps://www.reddit.com subredditNz Found in r/z supplemental searchg?idrrrdate why_relevant relevance created_utc)datesrzSubreddit search failed for r/z: ru;Reddit rate-limited (429) — skipping remaining subredditszSubreddit search error for r/)rvlstrip _url_encoder USER_AGENTrP enumeratelenrQr.r:rtimestamp_to_dater-rrr# Exception)rr]rrr all_itemsr{subrparamsfull_urlrr6richildrritemr dates_modrs rsearch_subredditsrfs6,I  'D0Bjj. B-cU-@C+d+,,KI;VabFax(H#oo,G 88Hgr1MDxx+// B?H%h/ '599V$,yy, HH["5  s9~a/01 '2!67==?3I;?!$TXXk3%?!@!F!F!H &1#6J$K!%#hh}5 4#,#>#>{#KDL  &1 '!0Bd ~~  6se2aSA B}}#WX  $ B 5cU"QC@ A A Bs$E(FH&+G H*HHrGc@ddl}|jj|S)z)Simple URL encoding for query parameters.rN) urllib.parseparse quote_plus)rGurllibs rrrs << " "4 ((rrEcg}d|vr|dr|d}t|tr|jdt|n t|}t d|t j r&t dtj|ddd|Sd }d |vr|d }t|tr|}nt|tr|D]}t|trq|jd dk(rS|jd g}|D];}t|ts|jd d k(s)|jdd }nnd|vr|d}nt|tr|}|sn|s)d|vr%|dD]} d| vs| djd d }n|s)tdt|jd|Stjd|} | r6 tj| j} | jdg}g} t#|D]=\} }t|ts|jdd }|rd|vr1d| dzt|jdd j%|t|jdd j%j'd|jdt|jdd j%t)dt+dt-|jd d!d"}|dr'tj.d#t|dsd|d<| j1|@| S#tj $rYfwxYw)$zParse OpenAI response to extract Reddit items. Args: response: Raw API response Returns: List of item dicts rrIzOpenAI API error: zFull error response: )indentNir:rHrDrLrJrGchoiceszH[REDDIT WARNING] No output text found in OpenAI response. Keys present: T)rz\{[\s\S]*"items"[\s\S]*\}itemsrrRrrrryrrg?grg?rz^\d{4}-\d{2}-\d{2}$)rNrOrPrQrrDEBUGr0dumpslistprintkeysresearchr1groupr2rr.rminmaxfloatmatchr-)rErrerr_msgrJrHrrLcchoice json_matchr6 clean_itemsrr clean_items rparse_reddit_responsersT E(x0!6@6M%))Is5z2SVW\S]'y12 :: .tzz(1/Met/T.UV W K8(# fc " K  % dD)xx'94"&((9b"9!(&A)!T2quuV} 7U./eeFB.? %& 4&*6l c*"&K  90y) FF"$Y/33IrB    XY]^f^k^k^mYnXopx|} 7EJ ::j..01DHHWb)E KU#'4$% hhub!l#- acU)'2./557TXXk267==?FFtLHHV$ <=CCES#c5+s1K+L"MN  f 882C 68J4KL%) 6":&/'2 =##   s5M M$#M$)r[rNNF)r*)#__doc__r0rrtypingrrrrr:rr rrQrrrboolr'rrrr7rBrSrrrvr}rrintrrrrrrrsy7 ,,"8,C 3 $..T"=GCCHT#s(^$<,stDcN';$#S#T#s(^#P  (V))) +# +# +##3UX]abegjbj]kF $$(x0 x0 x0 x0 x0  x0  x0x0 x0D>x0 x0 #s(^x0@ KS K KK K  K  $sCx. K\)c)c) YDcNYtDcN7KYr