If any terminology I use below is unfamiliar, you can easily find all of them on Wikipedia. The concept you need is that of measure spaces and the integrals with respect to arbitrary measures. A measure space $(X,\mathcal{M},\mu)$ is a triple of information, having a set $X$, a $\sigma$-algebra $\mathcal{M}$ on $X$, and a measure $\mu$ defined on the $\sigma$-algebra $\mathcal{M}$. Now, one considers complex-valued functions $f:X\to \Bbb{C}$ (which are $\mathcal{M}$-$\mathcal{B}(\Bbb{C})$ measurable, i.e for every Borel subset $E\subset\Bbb{C}$, $f^{-1}(E)\in\mathcal{M}$). Given any $0<p<\infty$, we define $\mathcal{L}^p(\mu)$ to be the set of all measurable $f:X\to \Bbb{C}$ such that
\begin{align}
\int_X|f|^p\,d\mu <\infty.
\end{align}
Often though, we write $\mathcal{L}^p(X)$ instead, but it should be noted that what is important is not the set $X$, but the measure $\mu$, because we can always consider different measures on the same set, so logically, it is important to clarify the measure (but usually from context one infers the measure, so one instead specifies the set).
Now, let us consider special examples:
Consider $X=\Bbb{R}$, $\mathcal{M}$ to be the Lebesuge $\sigma$-algebra and $\mu_{\text{Lebesgue}}$ the Lebesgue measure. Then, $\mathcal{L}^p(\mu_{\text{Lebesgue}})$, which again is typically written as $\mathcal{L}^p(\Bbb{R})$, is the set of Lebesgue-measurable functions $f:\Bbb{R}\to\Bbb{C}$ such that $\int_{\Bbb{R}}|f|^p\,d\mu_{\text{Lebesgue}}\equiv\int_{\Bbb{R}}|f(x)|^p\,dx<\infty$. This is the Lebesgue integral with respect to Lebesgue measure on $\Bbb{R}$.... so VERY roughly speaking, this is the integral we all know and are familiar with.
As another example, consider ANY non-empty set $X$. We consider $\mathcal{M}=\mathcal{P}(X)$ the $\sigma$-algebra to be the full power set of $X$ (i.e every set is measurable and thus all functions on $X$ will be measurable). We also consider the counting measure which is defined as $\mu_{\text{counting}}(E)= \text{number of elements in $E$}$ if $E$ is a finite set, and $\mu_{\text{counting}}(E):=\infty$ otherwise. In this case, $\mathcal{L}^p(\mu_{\text{counting}})$ is the set of functions $f:X\to\Bbb{C}$ such that
\begin{align}
\int_X|f|^p\,d\mu_{\text{counting}}<\infty
\end{align}
By unwinding the definition of the counting measure and the integral, we see that $\mathcal{L}^p(\mu_{\text{counting}})$ consists of precisely those functions $f:X\to\Bbb{C}$ such that
\begin{align}
\sup\left\{\sum_{x\in F}|f(x)|^p\,:\, \text{$F$ is a finite subset of $X$}\right\}<\infty.\tag{$*$}
\end{align}
It is tradition that whenever we use the counting measure on a set $X$, rather than writing $\mathcal{L}^p(\mu_{\text{counting}})$ or $\mathcal{L}^p(X)$ or $\mathcal{L}^p(X,\mathcal{P}(X),\mu_{\text{counting}})$, we instead use the notation $\ell^p(X)$.
So, to repeat once again, given a non-empty set $X$ and $0<p<\infty$, we define $\ell^p(X):=\mathcal{L}^p(X,\mathcal{P}(X),\mu_{\text{counting}})$, and this is precisely the set of all functions $f:X\to \Bbb{C}$ such that the supremum in $(*)$ above is finite.
So, for example we can take $X=\Bbb{R}^n$, or $X=\Bbb{C}$, or $X=\Bbb{R}$, or $X=\text{set of all functions $\Bbb{R}^4\to\Bbb{R}^5$}$ or literally any other set you can think of. Notice that if $X$ is a finite set, then the above finiteness condition in $(*)$ above is trivially satisfied, so that $\ell^p(X)$ is simply the set of all functions $X\to\Bbb{C}$ (this is certainly in bijection with $\Bbb{C}^{|X|}$, where $|X|$ is the number of elements in $X$). Most commonly though, we take $X=\Bbb{Z}$ or $X=\Bbb{N}$. Recall that a function from $\Bbb{N}$ or $\Bbb{Z}$ is nothing other than a sequence (in fact a sequence is defined as a function having some subset of $\Bbb{Z}$ as its domain).
Emphasizing this once again, the notation $\ell^p(X)$ is NOT because we're thinking of a sequence space. The notation $\ell^p(X)$ means that we're considering the counting measure on $X$, and considering a certain function space (the case of $X=\Bbb{Z}$ or $\Bbb{N}$ is a (useful) hyper special case).
One other fact I should point out: if $f\in\ell^p(X)$, then $\{x\in X\,:\, f(x)\neq 0\}$ is at most countable (another way of saying it is that an uncountable sum of strictly positive numbers is always infinite). So, in this sense, for an element $f\in \ell^p(X)$, there are only (at most) countably many values to deal with, so it's roughly a sequence, with many zeros.
Best Answer
I might be misunderstanding what the question is asking, but how about something like:
$$I = \{i+1 \in \mathbb{N}_{|X|}\ |\ x_{i+1} > 4 \}$$
Where $\mathbb{N}_{|X|}$ denotes the natural numbers modulo $|X|$, so $\{0,1,...,|X|-1\}$.