gr8testgad-1/Movie-Review-Analysis
0
1o
2 �5eg � @ s: d dl Z d dlZe �d�Zee jjj�Zej Z3dd� Z dS )� NZen_core_web_smc C s t | �}dd� |D �}d�|�S )Nc S s& g | ]}|j tvr|j tvr|j �qS � )�text� stopwords� punctuations)�.0�tokenr r �MC:\Users\Israel Anaba\Desktop\Movie_Review_Analysis\src\text_preprocessing.py�4<listcomp> s & z process_text.<locals>.<listcomp>� )�nlp�join)r �doc�tokensr r r � process_text5 s 6r ) �spacy�string�loadr �set�lang�enZ7STOP_WORDSr � punctuationr r r r r r �<module> s 8