Skip to content

EasyNote is an application that uses CoreML Framework to allow students to easily and more efficiently take notes with features such as speech-to-text, article analysis, and text summary.

Notifications You must be signed in to change notification settings

vuppalli/EasyNote

Repository files navigation

College-NoteTaker

An application that allows easier and more efficient note taking by:

  • allowing speech to text for faster note-taking and ease in writing
  • ability to add articles and fully interpret through sentiment analysis and subject classification
  • having a capability to summarize text for article and note summaries

Article Analysis for this NYTimes article:

Requirements

Xcode 10 and iOS 11

Model

Scikit-Learn's Pipeline was created using a Dict Vectorizer and a Linear SVM and was then converted into the CoreML Model using the coremltools python package. This classifier was used to distinguish between positive and negative phrases with the best CV score = 0.8483333333333334 and was trained with the Pang and Lee's Movie Review dataset.

Running and Converting the Model

To run the model, python and pip should already be installed, inlcuding several other libraries such as:

  • pandas: pip install --user pandas
  • numpy: pip install --user numpy
  • coremltools: pip install -U coremltools
  • nltk: pip install -U nltk

Then, the following code can be run:

cd SentimentPolarity
python sentAnalysis.py

Features

  • Best test score: 0.835
  • Best CV score: 0.8483333333333334

Summarizer

Created using the steps outlined by DEV. The process involves using Apple's Natural Language Framework to tokenize words, identify languages, and use tag schemes.

Usage

To use the summarizer alone, copy summarizer.swift into your project.

let summarizer = Summarizer()
let text = "Article's Text"
let summary = summarizer.summarize(text: text)

The variable summaryIntensity can be altered for favored summary length.

Example

This NYTimes article is summarized as:

Trump’s preferred pastime — the president managed repeatedly to plug Turnberry, one of two Scottish resorts that bear his name, as he dealt with some of the most pressing diplomatic problems facing his administration to date.  It is a tactic that has alarmed ethics watchdogs, who say he is using his presidential platform to promote a resort that, according to financial filings, has been a burden on the family business.  He also plugged the Turnberry golf course again: “The weather is beautiful,” he wrote on Twitter, “and this place is incredible!” Ethics experts tend to be cynical about the president’s sentimental references to his resort.  Trump’s visits to properties owned, managed or branded by the Trump Organization amount to free publicity for the company and blur the line between his family business and presidential duties.  Trump appears to hold a special place in his heart for Turnberry, perhaps because of his love of golf and because his mother, Mary Anne MacLeod Trump, was born in Tong, a village some 300 miles from Turnberry, in the north of Scotland “I feel very comfortable here,” Mr.  Eisen said, “the president is forcing his foreign hosts and the United States to spend enormous amounts of money so that he can get free advertising for his resort.  politics politics New York business tech science sports obituaries today's paper corrections corrections opinion today's opinion today's opinion op-ed columnists editorials editorials contributing writers op-ed Contributors letters letters sunday review sunday review taking note video: opinion arts today's arts art & design books dance movies music television theater video: arts living automobiles automobiles crossword food food education fashion & style health jobs magazine real estate t magazine travel weddings listings & more Reader Center tools & services N.  politics politics New York business tech science sports obituaries today's paper corrections corrections opinion today's opinion today's opinion op-ed columnists editorials editorials contributing writers op-ed Contributors letters letters sunday review sunday review taking note video: opinion arts today's arts art & design books dance movies music television theater video: arts living automobiles automobiles crossword food food education fashion & style health jobs magazine real estate magazine travel weddings more Reader Center tools & services.

App Installation

git clone https://github.com/cocoa-ai/College-NoteTaker.git
cd College-NoteTaker
open College-NoteTaker.xcworkspace/

Built With

  • Firebase - to store, retreive, and save note information
  • SiriKit - for speech-to-text trasncription
  • CoreML Framework - to integrate trained machine learning models into the application
  • Scikit-Learn - write machine learning classifiers in python
  • SwiftSoup - download and parse HTML from websites
  • DocumentClassifier - to categorize text into one of 5 categories

Creators

Vismita Uppalli

Note

The application can be useful in several settings such as real-time transciption of a professor, or reading a textbook out loud for studying purposes. Furthermore, the app can be scaled to use in meetings as a final summarizer for everything that was spoken.

About

EasyNote is an application that uses CoreML Framework to allow students to easily and more efficiently take notes with features such as speech-to-text, article analysis, and text summary.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published