Skip to content

ID-167: Upload zip#74

Merged
Artem-Goldenberg merged 4 commits intotask181_train_with_dataloaderfrom
task167_upload_zip
Dec 19, 2023
Merged

ID-167: Upload zip#74
Artem-Goldenberg merged 4 commits intotask181_train_with_dataloaderfrom
task167_upload_zip

Conversation

@Artem-Goldenberg
Copy link
Contributor

@Artem-Goldenberg Artem-Goldenberg commented Dec 13, 2023

Тесты не проходят из-за тестов Графа, Леня пофиксил плиз
Заливаю в большой пр, чтобы там пофиксилась сборка

Добавил новый метод к update_model теперь есть еще PATCH. Который загружает файл csv или zip на сервер.
Для предикт будет в следующем пре уже

Большие файлы с 50 мб загружает

@Artem-Goldenberg Artem-Goldenberg changed the base branch from main to task181_zip December 13, 2023 19:15
@Artem-Goldenberg Artem-Goldenberg changed the base branch from task181_zip to main December 13, 2023 19:15
@Artem-Goldenberg Artem-Goldenberg force-pushed the task167_upload_zip branch 3 times, most recently from bed1888 to 2a64827 Compare December 18, 2023 22:25
@Artem-Goldenberg Artem-Goldenberg changed the base branch from main to task181_train_with_dataloader December 18, 2023 22:26
@Artem-Goldenberg Artem-Goldenberg marked this pull request as ready for review December 18, 2023 22:53
Copy link
Contributor

@lpetrov02 lpetrov02 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

В одном месте я прям так сильно не понял, в остальном - норм)

std::vector<char> file_data(info.size);
zip_fread(file, file_data.data(), info.size);
fout.write(file_data.data(), info.size);
char *file_data = new char[info.size];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

А где delete??

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

да точно, забыла delete, ну не зря мы все таки смотрим

char *file_data = new char[info.size];
zip_fread(file, file_data, info.size);
fout.write(file_data, info.size);
fout.close();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Кажется, один из смыслов использования std::ofstream - это как раз то, что закроется оно само в деструкторе объекта

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

а да? ну окей тогда можно убрать

@Artem-Goldenberg Artem-Goldenberg merged commit 813bc2c into task181_train_with_dataloader Dec 19, 2023
@Artem-Goldenberg Artem-Goldenberg deleted the task167_upload_zip branch December 19, 2023 22:41
lpetrov02 added a commit that referenced this pull request Dec 20, 2023
* Started migration from Data2dLayer to DataLayer

Makes preparations for metrics logging on python
Functionality for c++ http added, but not working yet
Adds saving train metrics
Adds saving train metrics and responding with PNG

Adaptates code for new 4D blob

cpprest CI support
Add load possibility for zip
Add load possibility for png on predict
-------
GRA-122: Data loader implementation (#67)
Data loader implementation
-------
ID-154: Loss type selection (#70)
* Add loss type selection
* Add loss type selection
* Remove layer-class loss
* Clean up Loss type
* Make format
-------
ID-171: Fix input selection (#69)
* Fix input selection
* Clean up fix input selection
-------
Change train and predict for zip file case
Starts fixing train
Fixes train with dataloader
It's not fucking working :( (x3)
server train fix
Fixes train and predcit

* Follow up review

* Follow up review

* ID-167: Upload zip (#74)

* Fixes graph tests

* Fixes DataLayer

---------

Co-authored-by: lpetrov02 <lpetrov02@mail.ru>
Co-authored-by: Artem Goldenberg <58527023+Artem-Goldenberg@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants