Echo-AI-official/wfwofjfefwfwfwfwfaf

:zap: [Enhance] Add ignore classes for wikipedia.org

:zap: [Enhance] Loop multiple conditions for extracting abstract

:boom: [Fix] PermissionError: [Errno 13] Permission denied: /app/files

:gem: [Feature] Sync to Hugginface space, and run in docker

:boom: [Fix] SearchAPIApp: incorrect order of extracted contents to urls

:pencil: [Config] Generate requirements.txt

:recycle: [Refactor] Replace output_path with html_path to avoid confuse

:gem: [Feature] SearchAPIApp: Concurrent fetch urls and extract contents

:boom: [Fix] WebpageFetcher: raise timeout when request.get hangs

:boom: [Fix] WebpageContentExtractor: UnicodeDecodeError

:recycle: [Refactor] QueryResultsExtractor: prettify logging

:zap: [Enhance] BatchWebpageFetcher: return url_and_output_path_list

:gem: [Feature] New BatchWebpageContentExtractor: Extract webpage content from multiple html_paths concurrently

:gem: [Feature] New BatchWebpageFetcher: Fetch multiple urls concurrently

:boom: [Fix] Duplicated query_results in response JSON when passing multiple queries

:zap: [Enhance] WebpageContentExtractor: Escape dash, and ignore

:zap: [Enhance] ignore classes pattern, especially for 163.com

:zap: [Enhance] Rename HTMLFetcher to WebpageFetcher, and add output_parent param

:zap: [Enhance] SearchAPIApp: overwrite param for query and webpage HTML

:recycle: [Refactor] WebpageContentExtractor: Separate html and markdown processing

:recycle: [Refactor] Move hardcoded consts to network_configs

:zap: [Enhance] HTMLFetcher and GoogleSearcher: support cache with overwrite, and ignore host

:gem: [Feature] SearchAPIApp: New extract_content param

:gem: [Feature] New WebpageContentExtractor: extract webpage content as clean markdown

:recycle: [Refactor] HTMLFetcher: replace save_path with output_path

:gem: [Feature] Enable SearchAPIApp: /queries_to_search_results

:zap: [Enhance] GoogleSearcher: Add params of result_sum and safe

:recycle: [Refactor] Rename SearchResultsExtractor to QueryResultsExtractor, and store results

:zap: [Enhance] FilepathConverter: New parent param when init

:gem: [Feature] New HTMLFetcher: download url to local html file

:gem: [Feature] New FilepathConverter: convert urls and queries to valid file path

:recycle: [Refactor] Move header constructor, and prettier logging

:gem: [Feature] SearchResultsExtractor: related questions

:gem: [Feature] New SearchResultsExtractor: title, site, link, abstract

:pencil: [Doc] Readme and git ignore

:gem: [Feature] New Enver and Logger

:gem: [Feature] New GoogleSearcher: Enable google search with query