ECCC-Report TR21-027https://eccc.weizmann.ac.il/report/2021/027Comments and Revisions published for TR21-027en-usWed, 24 Feb 2021 04:18:04 +0200
Paper TR21-027
| Almost Optimal Super-Constant-Pass Streaming Lower Bounds for Reachability |
Lijie Chen,
Gillat Kol,
Dmitry Paramonov,
Raghuvansh Saxena,
Zhao Song,
Huacheng Yu
https://eccc.weizmann.ac.il/report/2021/027We give an almost quadratic $n^{2-o(1)}$ lower bound on the space consumption of any $o(\sqrt{\log n})$-pass streaming algorithm solving the (directed) $s$-$t$ reachability problem. This means that any such algorithm must essentially store the entire graph. As corollaries, we obtain almost quadratic space lower bounds for additional fundamental problems, including maximum matching, shortest path, matrix rank, and linear programming.
Our main technical contribution is the definition and construction of set hiding graphs, that may be of independent interest: we give a general way of encoding a set $S \subseteq [k]$ as a directed graph with $n = k^{ 1 + o( 1 ) }$ vertices, such that deciding whether $i \in S$ boils down to deciding if $t_i$ is reachable from $s_i$, for a specific pair of vertices $(s_i,t_i)$ in the graph. Furthermore, we prove that our graph ``hides'' $S$, in the sense that no low-space streaming algorithm with a small number of passes can learn (almost) anything about $S$. Wed, 24 Feb 2021 04:18:04 +0200https://eccc.weizmann.ac.il/report/2021/027