-
Notifications
You must be signed in to change notification settings - Fork 5.5k
fix concat then filter #397
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| kwargs['col_set'] = ['filter'] | ||
| data_filter = super()._prepare_seg(slc=slc, **kwargs) | ||
| if kwargs.get('data_key') == DataHandlerLP.DK_L: | ||
| col_filter = data_filter['filter']['keep_train'] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please don't hardcode them
| if kwargs.get('data_key') == DataHandlerLP.DK_L: | ||
| col_filter = data_filter['filter']['keep_train'] | ||
| elif kwargs.get('data_key') == DataHandlerLP.DK_I: | ||
| col_filter = data_filter['filter']['keep_test'] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
discussion....
|
|
||
| # TSDatasetH will retrieve more data for complete | ||
| data = super()._prepare_seg(slice(pad_start, end), **kwargs) | ||
| col_filter = _prepare_col_filter(slice(pad_start, end), **kwargs) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
discussion
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| if col_filter[idx2]: | ||
| idx_map[idx] = (i, j) | ||
| idx += 1 | ||
| idx2 += 1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| # The index of usable data is between start_idx and end_idx | ||
| self.start_idx, self.end_idx = self.data.index.slice_locs(start=pd.Timestamp(start), end=pd.Timestamp(end)) | ||
| self.idx_df, self.idx_map = self.build_index(self.data) | ||
| if col_filter is None: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
notice padding
|
|
||
| # TSDatasetH will retrieve more data for complete | ||
| data = super()._prepare_seg(slice(pad_start, end), **kwargs) | ||
| col_filter = _prepare_col_filter(slice(pad_start, end), **kwargs) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
|
Closed due to the same feature merged in #290 |
…microsoft#409) * Fixes on kaggle output * feat: add kaggle s3e14 template (microsoft#394) * add s3e14 template * fix CI * Initialisation of a template of competition * add kaggle s3e16 template (microsoft#396) * get kaggle competition scores (microsoft#397) * Adding a new competition s4e6 * feat: s4e5 (microsoft#400) * init for s4e5 * edit s4e5 * ci issue * feat: S4e3 (microsoft#402) * Initialisation of a template of competition * Adding a new competition s4e6 * Competition Initialised * Fixed to make sure that now it runs * Fixing for CI * correct evaluation (microsoft#403) * find rank in leaderboard (microsoft#405) * fix: model templates for KG scenario (microsoft#408) * fix feature selection for some models * feat select template * Updating the prompts for a more powerful model tuning * refine the prompt * fix: template error in s4e6 * feat: show simple execution time in demo (microsoft#410) * show time in kaggle demo * change color * fix a small bug * edit loop.py and proposal * delete useless files * CI issues * ci issue --------- Co-authored-by: XianBW <36835909+XianBW@users.noreply.github.com> Co-authored-by: Haoran Pan <167847254+TPLin22@users.noreply.github.com> Co-authored-by: Way2Learn <118058822+Xisen-Wang@users.noreply.github.com> Co-authored-by: WinstonLiyt <1957922024@qq.com> Co-authored-by: TPLin22 <tplin2@163.com>


Description
Motivation and Context
How Has This Been Tested?
pytest qlib/tests/test_all_pipeline.pyunder upper directory ofqlib.Screenshots of Test Results (if appropriate):
Types of changes