somAzzz/yahoo-finance-data

The Financial data from Yahoo!

<table border=1 cellpadding=10><tr><td>

\\\ Key Points to Note \\\

All financial data is sourced from Yahoo!Ⓡ Finance, Nasdaq!Ⓡ, and the U.S. Department of the Treasury via publicly available APIs, and is intended for research and educational purposes.

I will update the data regularly, and you are welcome to follow this project and use the data.

Each time the data is updated, I will record the update time in spec.json.

</td></tr></table>

Data Usage Instructions

Use DuckDB or Python API or Claude AI or Manus AI to Access Data

All datasets are publicly accessible and stored in Parquet format.

When using AI, you can also use skills for enhanced data analysis capabilities.

Datasets Overview

1. 1.stock_profile
2. 2.Source: https://finance.yahoo.com/quote/{$symbol}/profile/
3. 3.Description: Contains company details such as address, industry, and employee count.
4. 4.Columns: | Column Name | Column Type | Description | |-----------------------|-------------|----------------------------| | symbol | VARCHAR | Stock ticker symbol | | address | VARCHAR | Company address | | city | VARCHAR | City | | country | VARCHAR | Country | | phone | VARCHAR | Phone number | | zip | VARCHAR | Zip code | | industry | VARCHAR | Industry type | | sector | VARCHAR | Business sector | | longbusinesssummary | VARCHAR | Business summary | | fulltimeemployees | INTEGER | Number of full-time staff | | report_date | VARCHAR | Data reporting date |

1. 1.stock_officers
2. 2.Source: https://finance.yahoo.com/quote/{$symbol}/profile/
3. 3.Description: Lists company executives, including their pay and title.
4. 4.Columns: | Column Name | Column Type | Description | |--------------|-------------|--------------------------| | symbol | VARCHAR | Stock ticker symbol | | name | VARCHAR | Executive's name | | title | VARCHAR | Executive's job title | | age | INTEGER | Executive's age | | born | INTEGER | Year of birth | | pay | INTEGER | Wage (USD) | | exercised | INTEGER | Stock options exercised | | unexercised | INTEGER | Unexercised stock options|

1. 1.stock_tailing_eps
2. 2.Source: https://ycharts.com/companies/${symbol}/eps_ttm
3. 3.Description: Provides financial metrics such as Trailing earnings per share (TTM EPS).
4. 4.Columns: | Column Name | Column Type | Description | |--------------|-----------------|--------------------------| | symbol | VARCHAR | Stock ticker symbol | | reportdate | VARCHAR | Reporting date | | tailingeps | DECIMAL(38,2) | Trailing EPS | | update_time | VARCHAR | Last update time |

1. 1.stock_earning_calendar
2. 2.Source: https://www.nasdaq.com/market-activity/earnings
3. 3.Description: Contains information about companies' earnings reports, including their ticker symbols, reporting dates, names, and fiscal quarter end dates.
4. 4.Columns: | Column Name | Column Type | Description | |-----------------------|-------------|----------------------------------| | symbol | VARCHAR | Stock ticker symbol | | reportdate | VARCHAR | Reporting date | | name | VARCHAR | Company Simple Name | | fiscalquarter_ending | VARCHAR | Fiscal quarter end date |

1. 1.stock_statement
2. 2.Source: https://finance.yahoo.com/quote/${symbol}/financials/
3. 3.Description: Contains financial statement details of companies, including ticker symbols, reporting dates, specific financial items, their values, and related statement types and periods.
4. 4.Columns: | Column Name | Column Type | Description | |---------------|-----------------|-----------------------------------------------| | symbol | VARCHAR | Stock ticker symbol | | reportdate | VARCHAR | Reporting date | | itemname | VARCHAR | Name of the financial statement item | | itemvalue | DECIMAL(38,2) | Value of the financial statement item | | financetype | VARCHAR | Type of financial statement (e.g., balancesheet, incomestatement, cashflow) | | periodtype | VARCHAR | Reporting period type (e. g., annual, quarterly) |

1. 1.stock_prices
2. 2.Source: https://finance.yahoo.com/quote/${symbol}/chart
3. 3.Description: Contains historical stock market data, including ticker symbols, reporting dates, and key trading metrics such as open, close, high, low prices, and trading volume.
4. 4.Columns: | Column Name | Column Type | Description | |---------------|-----------------|-----------------------------------------| | symbol | VARCHAR | Stock ticker symbol | | report_date | VARCHAR | Trading date | | open | DECIMAL(38,2) | Opening price of the stock | | close | DECIMAL(38,2) | Closing price of the stock | | high | DECIMAL(38,2) | Highest price | | low | DECIMAL(38,2) | Lowest price | | volume | BIGINT | Number of shares traded |

1. 1.stock_dividend_events
2. 2.Source: https://finance.yahoo.com/quote/${symbol}/chart
3. 3.Description: Contains dividend data, including stock tickers, reporting dates, and dividend values.
4. 4.Columns: | Column Name | Column Type | Description | |---------------|-----------------|-----------------------------------------| | symbol | VARCHAR | Stock ticker symbol | | report_date | VARCHAR | Reporting date | | amount | DECIMAL(38,2) | Financial amount (e.g., dividend, interest) |

1. 1.stock_split_events
2. 2.Source: https://finance.yahoo.com/quote/${symbol}/chart
3. 3.Description: Contains data about stock splits, including the stock ticker, reporting date, and the split factor.
4. 4.Columns: | Column Name | Column Type | Description | |---------------|---------------|----------------------------------| | symbol | VARCHAR | Stock ticker symbol | | reportdate | VARCHAR | Reporting date | | splitfactor | VARCHAR | The factor by which shares are split |

1. 1.exchange_rate
2. 2.Source: https://finance.yahoo.com/quote/${symbol}/chart
3. 3.Description: Contains currency exchange data for a report date, including opening, closing, highest, and lowest prices.
4. 4.Columns: | Column Name | Column Type | Description | |---------------|---------------|----------------------------------| | symbol | VARCHAR | Stock ticker symbol | | report_date | VARCHAR | Reporting date | | open | DECIMAL(38,2) | Opening price | | close | DECIMAL(38,2) | Closing price | | high | DECIMAL(38,2) | Highest price during the day | | low | DECIMAL(38,2) | Lowest price during the day |

1. 1.daily_treasury_yield
2. 2.Source: https://home.treasury.gov/
3. 3.Description: Contains data related to daily treasury yield values for different time periods (monthly and yearly).
4. 4.Columns: | Column Name | Column Type | Description | |---------------|---------------|------------------------------------| | reportdate | VARCHAR | Reporting date | | bc1month | DECIMAL(38,2) | Treasury yield for 1 month | | bc2month | DECIMAL(38,2) | Treasury yield for 2 months | | bc3month | DECIMAL(38,2) | Treasury yield for 3 months | | bc6month | DECIMAL(38,2) | Treasury yield for 6 months | | bc1year | DECIMAL(38,2) | Treasury yield for 1 year | | bc2year | DECIMAL(38,2) | Treasury yield for 2 years | | bc3year | DECIMAL(38,2) | Treasury yield for 3 years | | bc5year | DECIMAL(38,2) | Treasury yield for 5 years | | bc7year | DECIMAL(38,2) | Treasury yield for 7 years | | bc10year | DECIMAL(38,2) | Treasury yield for 10 years | | bc30year | DECIMAL(38,2) | Treasury yield for 30 years |

1. 1.stock_earning_call_transcripts
2. 2.Source: https://finance.yahoo.com/quote/{symbol}/earnings-calls/
3. 3.Description: Contains verbatim transcripts of quarterly earnings calls for publicly traded companies, including speaker information and content segmentation.
4. 4.Columns: | Column Name | Data Type | Description | |-----------------|---------------------------------------------------------------|-----------------------------------------------------------------------------| | symbol | VARCHAR | The stock ticker symbol of the company | | fiscalyear | INTEGER | The fiscal year of the earnings call | | fiscalquarter | INTEGER | The fiscal quarter (1-4) of the earnings call | | reportdate | VARCHAR | The date when the earnings call was reported (format may vary) | | transcripts | STRUCT<paragraphnumber: INTEGER, speaker: VARCHAR, content: VARCHAR>[] | Array of structured transcript segments: paragraph_number: Sequential numbering of transcript paragraphs, speaker: Name and/or title of the speaker,content: The actual spoken content/text | | transcripts_id | INTEGER | Unique identifier for the transcript record |

1. 1.stock_news
2. 2.Source: https://news.yahoo.com/
3. 3.Description: Stores information about financial research reports or news articles, including metadata and content details
4. 4.Columns: | Column Name | Data Type | Description | |-----------------|---------------------------------------------------------------|-----------------------------------------------------------------------------| | uuid | VARCHAR | Unique identifier for the report/article (nullable) | | relatedsymbols | VARCHAR[] | Array of stock symbols or financial instruments related to the content | | title | VARCHAR | Title of the report/article (nullable) | | publisher | VARCHAR | Organization or entity that published the report (nullable) | | reportdate | VARCHAR | Date when the report was published (stored as string, nullable) | | type | VARCHAR | Classification or category of the report/article (nullable) | | link | VARCHAR | URL or reference link to the original content (nullable) | | news | STRUCT<paragraph_number: INTEGER, highlight: VARCHAR, paragraph: VARCHAR>[] | Array of structured paragraphs containing content with numbering, highlights, and text (nullable) |

1. 1.stock_revenue_breakdown
2. 2.Source:
3. 3.https://stockanalysis.com/stocks/${symbol}/metrics/revenue-by-segment/
4. 4.https://stockanalysis.com/stocks/${symbol}/metrics/revenue-by-product-group/
5. 5.https://stockanalysis.com/stocks/${symbol}/metrics/revenue-by-geography/
6. 6.Description: Stores information about revenue by segment and revenue by geography
7. 7.Columns: | Column Name | Data Type | Description | |----------------|---------------|--------------------------------------------------------------------------| | symbol | VARCHAR | The stock symbol or company identifier | | breakdowntype | VARCHAR | Type of financial breakdown (e.g., segment, geography, product) | | reportdate | VARCHAR | Date when the financial report was issued (format may vary) | | itemname | VARCHAR | Name of the specific financial line item being reported | | itemvalue | DECIMAL(38,2) | Numerical value of the financial item, with 2 decimal places precision |

1. 1.stock_shares_outstanding
2. 2.Source: https://ycharts.com/companies/${symbol}/shares_outstanding
3. 3.Description: Provides Shares Outstanding.
4. 4.Columns: | Column Name | Column Type | Description | |--------------|-----------------|--------------------------| | symbol | VARCHAR | Stock ticker symbol | | reportdate | VARCHAR | Reporting date | | sharesoutstanding | Long | Shares Outstanding |

1. 1.stock_sec_filing
2. 2.Source: https://www.sec.gov/cgi-bin/browse-edgar
3. 3.Description: Contains SEC (U.S. Securities and Exchange Commission) filing records for publicly traded companies. Supported form types include:
4. 4.US Domestic Company Forms:
5. 5.10-K, 10-K/A - Annual report
6. 6.10-Q, 10-Q/A - Quarterly report
7. 7.8-K, 8-K/A - Current report (material events)
8. 8.DEF 14A, DEFA14A - Proxy statement (shareholder meetings, executive compensation)
9. 9.Insider Trading Forms:
10. 10.3, 3/A - Initial beneficial ownership
11. 11.4, 4/A - Changes in beneficial ownership
12. 12.5, 5/A - Annual beneficial ownership
13. 13.144, 144/A - Notice of proposed sale of securities
14. 14.Institutional Holdings:
15. 15.13F-HR, 13F-HR/A - Institutional holdings report (quarterly)
16. 16.SC 13G, SC 13G/A - Passive investor holdings (>5%)
17. 17.SC 13D, SC 13D/A - Active investor holdings (>5%, may influence company)
18. 18.Foreign Private Issuer Forms (e.g., BABA, PDD, JD):
19. 19.20-F, 20-F/A - Annual report
20. 20.6-K, 6-K/A - Current report (quarterly + material events)
21. 21.Canadian Company Forms (e.g., SHOP, TD, RY):
22. 22.40-F, 40-F/A - Annual report
23. 23.ETF/Investment Company Forms (e.g., SPY, QQQ, VOO):
24. 24.N-CSR, N-CSR/A - Annual/Semi-annual shareholder report
25. 25.N-CSRS, N-CSRS/A - Semi-annual shareholder report
26. 26.N-30D, N-30D/A - Shareholder report (legacy format)
27. 27.NPORT-P - Monthly portfolio holdings
28. 28.N-CEN - Annual report (fund operations)
29. 29.N-Q, N-Q/A - Quarterly portfolio (discontinued, historical data exists)
30. 30.Columns: | Column Name | Column Type | Description | |------------------------|-------------|----------------------------------------------------------------| | cik | VARCHAR | Central Index Key - unique SEC identifier for the filer | | symbol | VARCHAR | Stock ticker symbol | | companyname | VARCHAR | Official company name as registered with SEC | | formtype | VARCHAR | SEC form type (e.g., 10-K, 10-Q, 8-K, 4, SC 13G) | | formtypedescription | VARCHAR | Human-readable description of the form type | | accessionnumber | VARCHAR | Unique identifier for the filing | | filingdate | VARCHAR | Date when the filing was submitted to SEC | | reportdate | VARCHAR | Period end date covered by the filing (if applicable) | | acceptancedatetime | VARCHAR | Timestamp when SEC accepted the filing | | filingurl | VARCHAR | Direct URL to the filing on SEC EDGAR |

Querying Datasets

Use the following SQL queries in DuckDB to retrieve data for a specific stock (e.g., TSLA):

1. 1.stock_profile

   SELECT * FROM 
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_profile.parquet' 
   WHERE symbol='TSLA';

1. 1.stock_officers

   SELECT * FROM 
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_officers.parquet' 
   WHERE symbol='TSLA';

1. 1.stock_tailing_eps

   SELECT * FROM 
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_tailing_eps.parquet' 
   WHERE symbol='TSLA';

1. 1.stock_earning_calendar

   SELECT * FROM
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_earning_calendar.parquet'
   WHERE symbol='TSLA';

1. 1.stock_statement

   SELECT * FROM 
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_statement.parquet' 
   WHERE symbol='TSLA' and finance_type='income_statement'

1. 1.stock_prices

   SELECT * FROM 
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_prices.parquet' 
   WHERE symbol='TSLA'

1. 1.stock_dividend_events

   SELECT * FROM 
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_dividend_events.parquet' 
   WHERE symbol='TSLA'

1. 1.stock_split_events

    SELECT * FROM 
        'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_split_events.parquet' 
    WHERE symbol='TSLA'

1. 1.exchange_rate

    SELECT * FROM 
        'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/exchange_rate.parquet' 
    WHERE symbol='EUR=X'

1. 1.daily_treasury_yield

    SELECT * FROM 
        'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/daily_treasury_yield.parquet'

1. 1.stock_earning_call_transcripts

    SELECT symbol,
        fiscal_year,
        fiscal_quarter,
        report_date,
        unnest(transcripts).paragraph_number,
        unnest(transcripts).speaker,
        unnest(transcripts).content 
    FROM 'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_earning_call_transcripts.parquet' 
    WHERE symbol='TSLA' AND fiscal_year=2024 AND fiscal_quarter=4;

1. 1.stock_news

    SELECT related_symbols, 
        uuid, 
        title, 
        publisher, 
        report_date, 
        type, 
        link, 
        unnest(news).paragraph_number, 
        unnest(news).highlight, 
        unnest(news).paragraph 
    FROM 'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_news.parquet' 
    WHERE uuid='00094540-141e-3893-a5ca-beb26abc150f';

1. 1.stock_revenue_breakdown

    SELECT *
    FROM 'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_revenue_breakdown.parquet'
    WHERE symbol='TSLA';

1. 1.stock_shares_outstanding

   SELECT * FROM
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_shares_outstanding.parquet'
   WHERE symbol='TSLA';

1. 1.stock_sec_filing

   SELECT * FROM
       'https://huggingface.co/datasets/defeatbeta/yahoo-finance-data/resolve/main/data/stock_sec_filing.parquet'
   WHERE symbol='TSLA' AND form_type='10-K';