?imdZddlZddlmZddlmZmZmZhdZ ddeee efdeee efde d e d e d ee ee ff d Z deee efd ee fd Z deee efd ee fdZ deee efd ee fdZy)zHEntity extraction from Phase 1 search results for supplemental searches.N)Counter)AnyDictList>xbbccnnjackmetaapplegithubgoogleopenairedditnytimesreuterstwitteryoutubeelonmuskverified microsoft wikipedia sundarpichaiwashingtonpost reddit_itemsx_items max_handles max_hashtagsmax_subredditsreturncbt|}t|}t|}|d||d||d|dS)aExtract key entities from Phase 1 results for supplemental searches. Parses X results for @handles and #hashtags, Reddit results for subreddit names and cross-referenced communities. Args: reddit_items: Raw Reddit item dicts from Phase 1 x_items: Raw X item dicts from Phase 1 max_handles: Maximum handles to return max_hashtags: Maximum hashtags to return max_subreddits: Maximum subreddits to return Returns: Dict with keys: x_handles, x_hashtags, reddit_subreddits N) x_handles x_hashtagsreddit_subreddits)_extract_x_handles_extract_x_hashtags_extract_subreddits)rrrrrhandleshashtags subredditss Y/home/ubuntu/.openclaw/workspace/skills/last30days-official/scripts/lib/entity_extract.pyextract_entitiesr,sL,!)G"7+H$\2J\k*} -'8 ct}|D]}|jddjjdj }|r|t vr ||xxdz cc<|jdd}t jd|}|D](}|j }|t vs||xxdz cc<*|jD cgc]\}} | c} }Scc} }w)zExtract and rank @handles from X results. Sources handles from: 1. author_handle field (who posted) 2. @mentions in post text (who they're talking about/to) Returns handles ranked by frequency, filtered for generic accounts. author_handle@textz @(\w{1,15})) rgetstriplstriplowerGENERIC_HANDLESrefindall most_common) r handle_countsitemauthorr3mentionsmention mention_lowerh_s r+r%r%2sIM 2/2.446==cBHHJ fO3 & !Q & !xx#::nd3 2G#MMOMO3m,1, 2 2(335 6$!QA 66 6s Cct}|D]L}|jdd}tjd|}|D]}||j xxdz cc<N|j Dcgc] \}}d| c}}Scc}}w)zZExtract and rank #hashtags from X results. Returns hashtags ranked by frequency. r3r0z #(\w{2,30})r2#)rr4r9r:r7r;)rhashtag_countsr=r3tagstagtrCs r+r&r&Os YN-xx#zz.$/ -C 399; '1 , ' --!/ : : < =1asG == =s/Bct}|D]}|jddjjd}|r ||xxdz cc<|jdgD],}t j d|}|D]}||xxdz cc<.|jdgD]>}|jdd}t j d|}|D]}||xxdz cc<@|j D cgc]\}} | c} }Scc} }w) zExtract and rank subreddits from Reddit results. Sources from: 1. subreddit field on each result 2. Cross-references in comment text (e.g., "check out r/localLLaMA") Returns subreddits ranked by frequency. subredditr0zr/r2comment_insightsz r/(\w{2,30}) top_commentsexcerpt)rr4r5r6r9r:r;) r sub_countsr=subinsight cross_refsrefcommentrNrCs r+r'r'`sJ%hh{B'--/66t<  sOq Oxx 2B7 %GOW=J! %31$ % % xx3 %Gkk)R0GOW=J! %31$ % %%()446 7FCC 77 7s7 D)rU)__doc__r9 collectionsrtypingrrrr8strintr,r%r&r'r-r+r]sN "" tCH~& $sCx. !     #tCy. B7T#s(^ 47c7:>d38n!5>$s)>"8d4S>&:8tCy8r-