A graph consists of vertices and edges, where vertices represent entities and edges represent relationships between vertices. Graphs can be represented sequentially using matrices like adjacency and incidence matrices, or linked using data structures like adjacency lists. Adjacency matrices allow fast addition/removal of edges but use more memory, while adjacency lists use less memory but are slower to modify. The best representation depends on whether the graph is dense or sparse.