Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Impl. duplicates identification #151

Draft
wants to merge 20 commits into
base: prescient/new_server
Choose a base branch
from
Draft

Impl. duplicates identification #151

wants to merge 20 commits into from

Conversation

dheshanm
Copy link
Member

No description provided.

@dheshanm
doc: Document and refactor config module
917fbe2 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
feat.: Add DB models
7b4dafd 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm dheshanm requested a review from kcho July 23, 2024 15:32
@dheshanm dheshanm self-assigned this Jul 23, 2024
@dheshanm
Copy link
Member Author

Proposed Schema:

IMG_50F1E610899B-1

Comments from Kevin:

  1. Store history of file_path for local PHOENIX files Table
  2. Add modality variable to file_mapping? eg) phone, interview, mri, eeg and others to the table?
  3. Consider adding ID of RA who added each remote_file. How about we add more info to Remote_file table eg) owner, modifier, last_modified ?

kcho
kcho reviewed Jul 29, 2024
View reviewed changes
Copy link
Member

@kcho kcho left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the commits! They look great. I'll see what I can do in sqlalchemy. I don't see the crawlers to add records to the db. Are we going to review the db models first before we work on crawlers?

lochness/config/__init__.py Outdated Show resolved Hide resolved
lochness/db/models/files_audit_log.py Show resolved Hide resolved
lochness/db/models/phoenix_files.py Show resolved Hide resolved
lochness/db/models/remote_files.py Show resolved Hide resolved
dheshanm and others added 15 commits July 30, 2024 01:16
@dheshanm
fix: execute_queries funtion
a00b9e9
@dheshanm
fix: models
ebb8702 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
feat.: Add Foreign Keys to mappings table
9419856 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
feat.: Impl. init db script
468637e 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
feat.: Add AutditLog to init_db
fa0c452
@dheshanm
fix: CREATE query
91dd085 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
fix: Add study_id to satisfy unique constraint
1116a53 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
feat.: Impl. DB crawler for metadata
35382f6 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
feat.: Impl. logging for crawler
270036c 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
fix: cast consent date to datetime
b5ff6df 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
fix: cast is_active to bool
0e244d9 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
fix: is_active type
a361ba7 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
fix: Minor DB schema adjustments
7643b81 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
feat.: Impl. Logging mediaflux downloads to DB
7b72d3e 
Signed-off-by: Dheshan Mohandass <[email protected]>
@dheshanm
feat.: Avoid spamming SQL to log
e7b74df 
Signed-off-by: Dheshan Mohandass <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@kcho kcho kcho approved these changes

Assignees

@dheshanm dheshanm

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@dheshanm @kcho