Skip to content

Commit

Permalink
deploy: a33c6c4
Browse files Browse the repository at this point in the history
  • Loading branch information
satabin committed Mar 13, 2024
1 parent 9ed8e15 commit 8b1874d
Show file tree
Hide file tree
Showing 18 changed files with 42 additions and 36 deletions.
2 changes: 1 addition & 1 deletion cookbooks/jq/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -256,7 +256,7 @@ <h3 id="transforming" class="section"><a class="anchor-link left" href="#transfo
<pre class="keep-together pdf epub"><code class="nohighlight"><span class="keyword">import</span><span> </span><span class="identifier">fs2</span><span>.</span><span class="identifier">data</span><span>.</span><span class="identifier">json</span><span>.</span><span class="identifier">jq</span><span>.</span><span class="type-name">Compiler</span><span>

</span><span class="keyword">val</span><span> </span><span class="identifier">queryCompiler</span><span> = </span><span class="type-name">Compiler</span><span>[</span><span class="type-name">IO</span><span>]
</span><span class="comment">// queryCompiler: Compiler[IO] = fs2.data.json.jq.internal.ESPJqCompiler@81fd7ef
</span><span class="comment">// queryCompiler: Compiler[IO] = fs2.data.json.jq.internal.ESPJqCompiler@51d880d
</span><span>
</span><span class="keyword">val</span><span> </span><span class="identifier">queryPipe</span><span> = </span><span class="identifier">queryCompiler</span><span>.</span><span class="identifier">compile</span><span>(</span><span class="identifier">query</span><span>).</span><span class="identifier">unsafeRunSync</span><span>()
</span><span class="comment">// queryPipe: fs2.package.Pipe[IO, json.Token, json.Token] = &lt;function1&gt;</span></code></pre>
Expand Down
14 changes: 10 additions & 4 deletions cookbooks/jsonlines/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -164,10 +164,16 @@ <h1 id="handling-json-lines-data" class="title">Handling JSON Lines data</h1>

<h2 id="reading-json-lines-data" class="section"><a class="anchor-link left" href="#reading-json-lines-data"><i class="icofont-laika link">&#xef71;</i></a>Reading JSON Lines data</h2>
<p>The <code>fs2-data</code> <a href="../../documentation/json/">JSON module</a> can natively read concatenated JSON values in an input stream This means that we can naively read data from the input stream and we will get the token stream out of it.</p>
<p>However, this way, we will not check that the input is actually respecting the JSON lines format. The format actually only has a few rules:
- Input must be UTF-8 encoded.
- Each line is a valid JSON value.
- Lines are separated by <code>\n</code>.</p>
<p>However, this way, we will not check that the input is actually respecting the JSON lines format. The format actually only has a few rules:</p>
<ul>
<li>Input must be UTF-8 encoded.</li>
</ul>
<ul>
<li>Each line is a valid JSON value.</li>
</ul>
<ul>
<li>Lines are separated by <code>\n</code>.</li>
</ul>
<p>We can leverage the operators provided by <code>fs2</code> and <code>fs2-data</code> to enforce these constraints when reading data.</p>
<pre><code class="nohighlight"><span class="keyword">import</span><span> </span><span class="identifier">cats</span><span>.</span><span class="identifier">effect</span><span>.</span><span class="identifier">unsafe</span><span>.</span><span class="identifier">implicits</span><span>.</span><span class="identifier">global</span><span>

Expand Down
4 changes: 2 additions & 2 deletions documentation/cbor-json/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -264,7 +264,7 @@ <h2 id="json-to-cbor" class="section"><a class="anchor-link left" href="#json-to
// NegativeInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@4e41d5aa,
// at = scodec.bits.ByteVector$AtArray@19801d57,
// offset = 0L,
// size = 1L
// )
Expand All @@ -273,7 +273,7 @@ <h2 id="json-to-cbor" class="section"><a class="anchor-link left" href="#json-to
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@54a7b60a,
// at = scodec.bits.ByteVector$AtArray@709dd0b8,
// offset = 0L,
// size = 2L
// )
Expand Down
30 changes: 15 additions & 15 deletions documentation/cbor/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -187,7 +187,7 @@ <h3 id="parsing-1" class="section"><a class="anchor-link left" href="#parsing-1"
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@77a10bc1,
// at = scodec.bits.ByteVector$AtArray@26a7fe5b,
// offset = 0L,
// size = 1L
// )
Expand All @@ -197,7 +197,7 @@ <h3 id="parsing-1" class="section"><a class="anchor-link left" href="#parsing-1"
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@2248f910,
// at = scodec.bits.ByteVector$AtArray@1f9195b,
// offset = 0L,
// size = 1L
// )
Expand All @@ -206,7 +206,7 @@ <h3 id="parsing-1" class="section"><a class="anchor-link left" href="#parsing-1"
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@389fed0c,
// at = scodec.bits.ByteVector$AtArray@4210d211,
// offset = 0L,
// size = 1L
// )
Expand All @@ -216,7 +216,7 @@ <h3 id="parsing-1" class="section"><a class="anchor-link left" href="#parsing-1"
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@59a7ec53,
// at = scodec.bits.ByteVector$AtArray@63838649,
// offset = 0L,
// size = 1L
// )
Expand All @@ -225,7 +225,7 @@ <h3 id="parsing-1" class="section"><a class="anchor-link left" href="#parsing-1"
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@26271ba5,
// at = scodec.bits.ByteVector$AtArray@7acfe944,
// offset = 0L,
// size = 1L
// )
Expand Down Expand Up @@ -340,7 +340,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@4342e608,
// at = scodec.bits.ByteVector$AtArray@33350487,
// offset = 0L,
// size = 1L
// )
Expand All @@ -350,7 +350,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@4f284e1,
// at = scodec.bits.ByteVector$AtArray@77f1d8aa,
// offset = 0L,
// size = 1L
// )
Expand All @@ -359,7 +359,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@62512558,
// at = scodec.bits.ByteVector$AtArray@8bfa9d3,
// offset = 0L,
// size = 1L
// )
Expand All @@ -369,7 +369,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@7cb5f084,
// at = scodec.bits.ByteVector$AtArray@dbff449,
// offset = 0L,
// size = 1L
// )
Expand All @@ -378,7 +378,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@28133bbc,
// at = scodec.bits.ByteVector$AtArray@1635d845,
// offset = 0L,
// size = 1L
// )
Expand All @@ -400,7 +400,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@38d667d3,
// at = scodec.bits.ByteVector$AtArray@6ff876a1,
// offset = 0L,
// size = 1L
// )
Expand All @@ -410,7 +410,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@53c6fe74,
// at = scodec.bits.ByteVector$AtArray@1a7cbbbc,
// offset = 0L,
// size = 1L
// )
Expand All @@ -419,7 +419,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@a41558,
// at = scodec.bits.ByteVector$AtArray@68931906,
// offset = 0L,
// size = 1L
// )
Expand All @@ -429,7 +429,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@31db002b,
// at = scodec.bits.ByteVector$AtArray@505c03a1,
// offset = 0L,
// size = 1L
// )
Expand All @@ -438,7 +438,7 @@ <h3 id="serializing-2" class="section"><a class="anchor-link left" href="#serial
// PositiveInt(
// bytes = Chunk(
// bytes = View(
// at = scodec.bits.ByteVector$AtArray@3ab8013c,
// at = scodec.bits.ByteVector$AtArray@7cbd2a75,
// offset = 0L,
// size = 1L
// )
Expand Down
14 changes: 7 additions & 7 deletions documentation/csv/generic/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -190,7 +190,7 @@ <h2 id="derivation-of-celldecoder-cellencoder" class="section"><a class="anchor-
}

</span><span class="keyword">implicit</span><span> </span><span class="keyword">val</span><span> </span><span class="identifier">stateDecoder</span><span> = </span><span class="identifier">deriveCellDecoder</span><span>[</span><span class="type-name">State</span><span>]
</span><span class="comment">// stateDecoder: CellDecoder[State] = fs2.data.csv.generic.internal.DerivedCellDecoder$$anonfun$coproductDecoder$3@4c818923
</span><span class="comment">// stateDecoder: CellDecoder[State] = fs2.data.csv.generic.internal.DerivedCellDecoder$$anonfun$coproductDecoder$3@54726307
// use stateDecoder to derive decoders for rows...or just test:
</span><span class="identifier">stateDecoder</span><span>(</span><span class="string-literal">&quot;On&quot;</span><span>)
</span><span class="comment">// res1: DecoderResult[State] = Right(value = On)
Expand All @@ -199,7 +199,7 @@ <h2 id="derivation-of-celldecoder-cellencoder" class="section"><a class="anchor-
</span><span>
</span><span class="comment">// same goes for the encoder
</span><span class="keyword">implicit</span><span> </span><span class="keyword">val</span><span> </span><span class="identifier">stateEncoder</span><span> = </span><span class="identifier">deriveCellEncoder</span><span>[</span><span class="type-name">State</span><span>]
</span><span class="comment">// stateEncoder: CellEncoder[State] = fs2.data.csv.generic.internal.DerivedCellEncoder$$anonfun$coproductEncoder$3@45d36f80
</span><span class="comment">// stateEncoder: CellEncoder[State] = fs2.data.csv.generic.internal.DerivedCellEncoder$$anonfun$coproductEncoder$3@4dc4797b
</span><span class="identifier">stateEncoder</span><span>(</span><span class="type-name">State</span><span>.</span><span class="type-name">On</span><span>)
</span><span class="comment">// res3: String = &quot;On&quot;</span></code></pre>
<p>The generic derivation for cell decoders also supports renaming and deriving instances for unary product types (case classes with one field):</p>
Expand All @@ -213,19 +213,19 @@ <h2 id="derivation-of-celldecoder-cellencoder" class="section"><a class="anchor-

</span><span class="comment">// works as we have an implicit CellDecoder[String]
</span><span class="keyword">implicit</span><span> </span><span class="keyword">val</span><span> </span><span class="identifier">unknownDecoder</span><span> = </span><span class="identifier">deriveCellDecoder</span><span>[</span><span class="type-name">Advanced</span><span>.</span><span class="type-name">Unknown</span><span>]
</span><span class="comment">// unknownDecoder: CellDecoder[Advanced.Unknown] = fs2.data.csv.generic.internal.DerivedCellDecoder$$anonfun$unaryProductDecoder$3@6aff5a51
</span><span class="comment">// unknownDecoder: CellDecoder[Advanced.Unknown] = fs2.data.csv.generic.internal.DerivedCellDecoder$$anonfun$unaryProductDecoder$3@4a75b0f0
</span><span class="keyword">implicit</span><span> </span><span class="keyword">val</span><span> </span><span class="identifier">advancedDecoder</span><span> = </span><span class="identifier">deriveCellDecoder</span><span>[</span><span class="type-name">Advanced</span><span>]
</span><span class="comment">// advancedDecoder: CellDecoder[Advanced] = fs2.data.csv.generic.internal.DerivedCellDecoder$$anonfun$coproductDecoder$3@1dbc0f8d
</span><span class="comment">// advancedDecoder: CellDecoder[Advanced] = fs2.data.csv.generic.internal.DerivedCellDecoder$$anonfun$coproductDecoder$3@15ab1d9e
</span><span>
</span><span class="identifier">advancedDecoder</span><span>(</span><span class="string-literal">&quot;Active&quot;</span><span>)
</span><span class="comment">// res4: DecoderResult[Advanced] = Right(value = On)
</span><span class="identifier">advancedDecoder</span><span>(</span><span class="string-literal">&quot;Off&quot;</span><span>)
</span><span class="comment">// res5: DecoderResult[Advanced] = Right(value = Unknown(name = &quot;Off&quot;))
</span><span>
</span><span class="keyword">implicit</span><span> </span><span class="keyword">val</span><span> </span><span class="identifier">unknownEncoder</span><span> = </span><span class="identifier">deriveCellEncoder</span><span>[</span><span class="type-name">Advanced</span><span>.</span><span class="type-name">Unknown</span><span>]
</span><span class="comment">// unknownEncoder: CellEncoder[Advanced.Unknown] = fs2.data.csv.generic.internal.DerivedCellEncoder$$anonfun$unaryProductEncoder$3@5db44588
</span><span class="comment">// unknownEncoder: CellEncoder[Advanced.Unknown] = fs2.data.csv.generic.internal.DerivedCellEncoder$$anonfun$unaryProductEncoder$3@52862e77
</span><span class="keyword">implicit</span><span> </span><span class="keyword">val</span><span> </span><span class="identifier">advancedEncoder</span><span> = </span><span class="identifier">deriveCellEncoder</span><span>[</span><span class="type-name">Advanced</span><span>]
</span><span class="comment">// advancedEncoder: CellEncoder[Advanced] = fs2.data.csv.generic.internal.DerivedCellEncoder$$anonfun$coproductEncoder$3@3458ed1
</span><span class="comment">// advancedEncoder: CellEncoder[Advanced] = fs2.data.csv.generic.internal.DerivedCellEncoder$$anonfun$coproductEncoder$3@3ce78afd
</span><span>
</span><span class="identifier">advancedEncoder</span><span>(</span><span class="type-name">Advanced</span><span>.</span><span class="type-name">On</span><span>)
</span><span class="comment">// res6: String = &quot;Active&quot;
Expand Down Expand Up @@ -269,7 +269,7 @@ <h2 id="derivation-of-csvrowdecoder" class="section"><a class="anchor-link left"
<pre><code class="nohighlight"><span class="keyword">import</span><span> </span><span class="identifier">fs2</span><span>.</span><span class="identifier">data</span><span>.</span><span class="identifier">csv</span><span>.</span><span class="identifier">generic</span><span>.</span><span class="identifier">semiauto</span><span>.</span><span class="identifier">_</span><span>

</span><span class="keyword">implicit</span><span> </span><span class="keyword">val</span><span> </span><span class="type-name">MyRowDecoder</span><span>: </span><span class="type-name">CsvRowDecoder</span><span>[</span><span class="type-name">MyRow</span><span>, </span><span class="type-name">String</span><span>] = </span><span class="identifier">deriveCsvRowDecoder</span><span>[</span><span class="type-name">MyRow</span><span>]
</span><span class="comment">// MyRowDecoder: CsvRowDecoder[MyRow, String] = fs2.data.csv.generic.internal.DerivedCsvRowDecoder$$anon$1@6e1fa445
</span><span class="comment">// MyRowDecoder: CsvRowDecoder[MyRow, String] = fs2.data.csv.generic.internal.DerivedCsvRowDecoder$$anon$1@3c1895fd
</span><span>
</span><span class="keyword">val</span><span> </span><span class="identifier">decoded</span><span> = </span><span class="identifier">stream</span><span>.</span><span class="identifier">through</span><span>(</span><span class="identifier">decodeUsingHeaders</span><span>[</span><span class="type-name">MyRow</span><span>]())
</span><span class="comment">// decoded: Stream[[x]Fallible[x], MyRow] = Stream(..)
Expand Down
Loading

0 comments on commit 8b1874d

Please sign in to comment.