-
- Downloads
Really only use PyUnicode_FromUnicode() when needed (GH-3697)
* Really only use PyUnicode_FromUnicode() for strings that contain lone surrogate, not for normal non-BMP strings and not for surrogate pairs on 16bit Unicode platforms. See https://github.com/cython/cython/issues/3678 * Extend buildenv test to debug a MacOS problem. * Add a test for surrogate pairs in Unicode strings. * Limit PyUnicode_FromUnicode() usage to strings containing lone surrogates. * Accept ambiguity of surrogate pairs in Unicode string literals when generated on 16bit Py2 systems.
Showing
- Cython/Compiler/ExprNodes.py 7 additions, 2 deletionsCython/Compiler/ExprNodes.py
- Cython/Compiler/StringEncoding.py 28 additions, 0 deletionsCython/Compiler/StringEncoding.py
- Cython/Compiler/Tests/TestStringEncoding.py 44 additions, 0 deletionsCython/Compiler/Tests/TestStringEncoding.py
- Cython/Utility/ModuleSetupCode.c 4 additions, 0 deletionsCython/Utility/ModuleSetupCode.c
- Cython/Utility/StringTools.c 7 additions, 2 deletionsCython/Utility/StringTools.c
- tests/compile/buildenv.pyx 8 additions, 0 deletionstests/compile/buildenv.pyx
- tests/run/unicodeliterals.pyx 17 additions, 0 deletionstests/run/unicodeliterals.pyx
Loading
Please register or sign in to comment