Jitendra12421/DATAENV

1# Quant Research Notes2 3This note explains why the supplementary data in `Alt Data` was added and which papers or official data sources motivated it.4 5## What was added6 7- `Alt Data/options/raw/`8  - Original NIFTY and BANKNIFTY daily option-chain data moved out of the root folder.9- `Alt Data/options/processed/`10  - Daily option features such as put-call ratios, open-interest changes, OI-weighted strikes, near-expiry ATM fields, and ATM straddle proxies.11- `Alt Data/external/raw/fred/`12  - Daily external macro and cross-market series from FRED.13- `Alt Data/external/processed/external_daily_panel.csv`14  - Aligned external panel with level, change, and return-style features where appropriate.15- `Alt Data/institutional/raw/`16  - Daily institutional cash and F&O flow extracts plus NSE participant-wise derivatives archives.17- `Alt Data/institutional/processed/institutional_daily_panel.csv`18  - Daily FII/DII cash buy-sell, index futures positioning, and index options positioning features.19 20## Why these data types matter21 22- Options open interest and option-chain structure:23  - Forward-looking positioning often shows up in put/call OI, OI changes, and near-expiry ATM behavior.24- Institutional flow and participant positioning:25  - FII and DII cash flows capture who supplied or absorbed equity risk each day, while participant-wise index futures and index options positioning exposes directional buildup and hedge pressure.26- Implied or volatility-linked information:27  - Volatility-sensitive features help both return and realized-volatility modeling.28- Macro and financial conditions:29  - Rates, dollar strength, FX, and energy prices often improve regime detection and market-state modeling.30- Global equity spillovers:31  - U.S. and Asia index moves commonly feed into next-session Indian index behavior.32 33## Papers used to guide the additions34 351. `Implied Volatility-Augmented GARCH Models: Evidence from the Indian Equity Market`36   - SSRN: <https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5586330>37   - Why it matters: motivates volatility-linked option information for NIFTY research.38 392. `On options-driven realized volatility forecasting: Information gains via rough volatility model`40   - arXiv: <https://arxiv.org/abs/2604.02743>41   - Why it matters: supports combining realized-volatility features with option-derived signals.42 433. `Nifty Index Options: Open Interest Analysis of Options Chain`44   - DOI mirror / metadata page: <https://www.researchgate.net/publication/355301566_Nifty_Index_Options_Open_Interest_Analysis_of_Options_Chain>45   - Why it matters: supports retaining and engineering option-chain open-interest information for NIFTY.46 474. `Forecasting Individual Stock Returns Using Macroeconomic and Technical Variables`48   - SSRN PDF landing page: <https://papers.ssrn.com/sol3/Delivery.cfm/SSRN_ID3768866_code2747161.pdf?abstractid=3339603&mirid=1&type=2>49   - Why it matters: supports combining technical features with macro variables rather than using price history alone.50 515. `Stock prices and Macroeconomic indicators: Investigating a correlation in Indian context`52   - arXiv: <https://arxiv.org/abs/2112.08071>53   - Why it matters: supports adding exchange-rate, oil, gold, and rate-style macro context in Indian-market research.54 55## Official data sources used56 57- FRED S&P 500: <https://fred.stlouisfed.org/series/SP500>58- FRED NASDAQ Composite: <https://fred.stlouisfed.org/series/NASDAQCOM>59- FRED Dow Jones Industrial Average: <https://fred.stlouisfed.org/series/DJIA>60- FRED Nikkei 225: <https://fred.stlouisfed.org/series/NIKKEI225>61- FRED 10-Year Treasury Yield: <https://fred.stlouisfed.org/series/DGS10>62- FRED Effective Federal Funds Rate: <https://fred.stlouisfed.org/series/FEDFUNDS>63- FRED Indian Rupees to One U.S. Dollar: <https://fred.stlouisfed.org/series/DEXINUS>64- FRED Europe Brent Spot Price FOB: <https://fred.stlouisfed.org/series/DCOILBRENTEU>65- FRED CBOE VIX: <https://fred.stlouisfed.org/series/VIXCLS>66- FRED Broad U.S. Dollar Index: <https://fred.stlouisfed.org/series/DTWEXBGS>67- NSE participant-wise open interest archive: <https://archives.nseindia.com/content/nsccl/fao_participant_oi_01012024.csv>68- NSE participant-wise trading volume archive: <https://archives.nseindia.com/content/nsccl/fao_participant_vol_01012024.csv>69- NSE FII/DII report landing page: <https://www.nseindia.com/reports/fii-dii?segment=capital-market>70- Moneycontrol cash activity page: <https://www.moneycontrol.com/markets/fii-dii-data/cash/>71- Moneycontrol F&O activity page: <https://www.moneycontrol.com/markets/fii-dii-data/futures-and-options/>72 73## Practical use74 75- Start with `Data/processed/panels/daily_master_panel.csv` for daily modeling.76- Use `Data/processed/features/<timeframe>/` for single-asset intraday experiments.77- Join `Alt Data/options/processed/*.csv` into targeted option-flow studies when you want option-led predictors.78- Join `Alt Data/institutional/processed/institutional_daily_panel.csv` when you want daily institutional flow and positioning context.79