Skip to content

Literature Survey #10

Closed
Closed

Description

@JoelMathewC

Starting an issue to look into resources on GNN models, Temporal GNN models, GPU optimizations etc. This is necessary because there seems to be a greater understanding of the domain to decide on frontend requirements (incase a redesign is to be done), correctness of middleware/backend implementation and possible optimization opportunities.

Reading material covered in this issue are as follows

  • PyG-T
  • ChebShev
  • Temporal ChebShev
  • DCRNN
  • HGL
  • Neugraph (SAGA-NN)

Activity

  1. JoelMathewC commented on Feb 21, 2023

    @JoelMathewC
    ContributorAuthor

    Pytorch Geometric Temporal

    Paper Link: https://arxiv.org/abs/2104.07788
    Status: Completed reading entire paper

    Ideas for the project

    1. Try implementing DCRNN, because according to the paper in page 4, they state that they had to write custom code for diffusion, since it wasn't there in PyG. Took a very look at the implementation code here and it seems like quite a bit of logic, would be nice to see if a vertex centric-program can model this.
    2. The documentation updates every time the code base changes, that might help for us as well.
    3. Additionally in their future work they talk about building models for continuous time models (snapshots not at regular intervals) and temporal models which operate on curved spaces such as hyperbolic and spherical spaces.
  2. JoelMathewC commented on Mar 10, 2023

    @JoelMathewC
    ContributorAuthor

    HGL: Accelerating Heterogeneous GNN Training with Holistic Representation and Optimization

    Paper Link: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10046125
    Implementation Link: https://github.com/ytgui/HGL-proto/tree/0.1.0
    Status: Completed reading entire paper

    Ideas for project

    1. Make every graph a heterogenous graph, homogenous graphs are heterogenous graphs with 1 relation.
    2. Numeros optimization techniques for that approach, maybe some of them could be adopted
    3. Putting a pause on this now and looking into other branches.
  3. locked and limited conversation to collaborators on Apr 30, 2023
  4. converted this issue into a discussion #32 on Apr 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions