issue_comments

Table actions

3 rows where author_association = "NONE" and issue = 816526538 sorted by updated_at descending

✖
✖
✖

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: created_at (date), updated_at (date)

user 2

issue 1

  • sqlite-utils extract could handle nested objects · 3 ✖

author_association 1

  • NONE · 3 ✖
id html_url issue_url node_id user created_at updated_at ▲ author_association body reactions issue performed_via_github_app
1236200834 https://github.com/simonw/sqlite-utils/issues/239#issuecomment-1236200834 https://api.github.com/repos/simonw/sqlite-utils/issues/239 IC_kwDOCGYnMM5Jru2C hubgit 14294 2022-09-03T21:26:32Z 2022-09-03T21:26:32Z NONE

I was looking for something like this today, for extracting columns containing objects (and arrays of objects) into separate tables.

Would it make sense (especially for the fields containing arrays of objects) to create a one-to-many relationship, where each row of the newly created table would contain the id of the row that originally contained it?

If the extracted objects have a unique id and are repeated, it could even create a many-to-many relationship, with a third table for the joins.

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
 sqlite-utils extract could handle nested objects 816526538  
960295228 https://github.com/simonw/sqlite-utils/issues/239#issuecomment-960295228 https://api.github.com/repos/simonw/sqlite-utils/issues/239 IC_kwDOCGYnMM45PPE8 tmaier 350038 2021-11-03T23:35:37Z 2021-11-03T23:36:50Z NONE

I think I only wonder how I would parse the JSON value within such a lambda...

My naive approach would have been $ sqlite-utils convert demo.db statuses statuses 'return value' --multi

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
 sqlite-utils extract could handle nested objects 816526538  
960292442 https://github.com/simonw/sqlite-utils/issues/239#issuecomment-960292442 https://api.github.com/repos/simonw/sqlite-utils/issues/239 IC_kwDOCGYnMM45POZa tmaier 350038 2021-11-03T23:28:55Z 2021-11-03T23:28:55Z NONE

I am super interested in this feature.

After reading the other issues you referenced, I think the right way would be to use the current extract feature and then to use sqlite-utils convert to extract the json object into individual columns

 
{
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
 sqlite-utils extract could handle nested objects 816526538  

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [issue_comments] (
   [html_url] TEXT,
   [issue_url] TEXT,
   [id] INTEGER PRIMARY KEY,
   [node_id] TEXT,
   [user] INTEGER REFERENCES [users]([id]),
   [created_at] TEXT,
   [updated_at] TEXT,
   [author_association] TEXT,
   [body] TEXT,
   [reactions] TEXT,
   [issue] INTEGER REFERENCES [issues]([id])
, [performed_via_github_app] TEXT);
CREATE INDEX [idx_issue_comments_issue]
                ON [issue_comments] ([issue]);
CREATE INDEX [idx_issue_comments_user]
                ON [issue_comments] ([user]);