How to add LateX/Math to Windows 10 Ink API?
Asked Answered
F

3

7

From highlights of Microsoft Build 2016, I saw Microsoft was pushing its new Ink API.

  • What exactly are the new additions?
  • Can Ink
    • Understand handwriting and digitize it?
    • Understand Math/Equations and digitize it (ie Latex)?
  • Are there any other APIs that can do this for UWP or Unity?
  • How would I go about creating one myself?

Jeans link refers to custom recognition. Is this what I'm looking for? I feel like there should be an option to add symbols to the lookup dictionary.

Fic answered 7/4, 2016 at 0:50 Comment(0)
J
2

-Understand handwriting and digitize it?

Yes, that's the whole point of the API.

It's basically OCR 2.0

-Understand Math/Equations and digitize it (ie Latex)?

Nope. Or, at least, not yet because, of course, it would be a logical expansion of the API.

Are there any other APIs that can do this for UWP or Unity?

Not that I had heard of.

Finally, I don't think that Jeans link is what you are looking for. It's not simply a matter of adding a new symbol, but also to represent it conveniently.

For example, how would you do to display \frac{\,\frac{a}{b}\,}{\frac{c}{d}} ?

There is no correct way of positioning the a/b over the fraction bar and the c/d under it. Even if you can use superscript and subscript, there is no way for a standard police to align them vertically.

The good news is: Ink is an API, which means you could create a wrapper that would, for example, automate the latex pdf generation. So yes, you could create the functionality you're looking for with a bit on C# (as it looks you're on a Microsoft environment)

Take a look at this thread: https://tex.stackexchange.com/questions/53914/compile-tex-inside-microsoft-c-net

Best of luck!

Johnjohna answered 9/6, 2016 at 9:37 Comment(0)
U
3

Yes for the first point, you can convert ink strokes to text using handwriting recognition.

Recognize ink strokes

For math and equations, didn't see any default Recognizer at the moment.

Unerring answered 8/4, 2016 at 11:57 Comment(0)
J
2

-Understand handwriting and digitize it?

Yes, that's the whole point of the API.

It's basically OCR 2.0

-Understand Math/Equations and digitize it (ie Latex)?

Nope. Or, at least, not yet because, of course, it would be a logical expansion of the API.

Are there any other APIs that can do this for UWP or Unity?

Not that I had heard of.

Finally, I don't think that Jeans link is what you are looking for. It's not simply a matter of adding a new symbol, but also to represent it conveniently.

For example, how would you do to display \frac{\,\frac{a}{b}\,}{\frac{c}{d}} ?

There is no correct way of positioning the a/b over the fraction bar and the c/d under it. Even if you can use superscript and subscript, there is no way for a standard police to align them vertically.

The good news is: Ink is an API, which means you could create a wrapper that would, for example, automate the latex pdf generation. So yes, you could create the functionality you're looking for with a bit on C# (as it looks you're on a Microsoft environment)

Take a look at this thread: https://tex.stackexchange.com/questions/53914/compile-tex-inside-microsoft-c-net

Best of luck!

Johnjohna answered 9/6, 2016 at 9:37 Comment(0)
A
1

For LaTex, there's a Xamarin library called CSharpMath, which uses SkiaSharp to render the math expression. It is ported from the iosMath project.

As the library is .NetStandard, so it also means you can use it in an UWP app. The repository can be found here.

Ailee answered 16/9, 2019 at 17:36 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.