What's Chris Doing? - Latest Comments

Re: Cross Compiling Python Extensions

men li — Fri, 27 May 2016 03:38:38 -0000

Hi, Chris!
I want to cross compile the netifaces. The host I used is Ubuntu 64bit， and the target board is the arm board with the linux platform. Follow your steps, I changed the environment variables as follows:

export PYTHONXCPREFIX=/home/skyblue/a33_linux/a33_new/lichee/out/sun8iw5p1/linux/common/buildroot/target/python2.7.3/
export CROSS_COMPILE=arm-none-linux-gnueabi-
export CC="${CROSS_COMPILE}gcc -pthread"
export LDSHARED="${CC} -shared"
export CFLAGS="-I${PYTHONXCPREFIX}/include/python2.7"
export LDFLAGS="-L${PYTHONXCPREFIX}/../usr/lib -L${PYTHONXCPREFIX}/lib/python2.7/ -L${PYTHONXCPREFIX}/../lib"

And then I use the command "python setup.py build -x bdist_egg --plat-name=linux-arm" to compile the "egg". The "dist/netifaces-0.10.0-py2.7-linux-arm.egg" was producted successfully:

creating 'dist/netifaces-0.10.0-py2.7-linux-arm.egg' and adding 'build/bdist.linux-x86_64/egg' to it
removing 'build/bdist.linux-x86_64/egg' (and everything under it)

But the question comed when I copied the egg to the target board and excuted the command "easy_install netifaces-0.10.0-py2.7-linux-arm.egg" . It showed:

Processing dependencies for netifaces==0.10.0
Searching for netifaces==0.10.0
Reading https://pypi.python.org/sim...
Best match: netifaces 0.10.0
Downloading https://pypi.python.org/pac...
Processing netifaces-0.10.0.tar.gz
Writing /tmp/easy_install-6ZyFwD/netifaces-0.10.0/setup.cfg
Running netifaces-0.10.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-6ZyFwD/netifaces-0.10.0/egg-dist-tmp-zaksgi
checking for getifaddrs...not found.
checking for getnameinfo...not found.
checking for socket IOCTLs...not found.
checking for optional header files...none found.
checking whether struct sockaddr has a length field...no.
checking which sockaddr_xxx structs are defined...none!
checking for routing socket support...no.
checking for sysctl(CTL_NET...) support...no.
checking for netlink support...no.
checking for RTF_IFSCOPE...no.
unable to execute arm-none-linux-gnueabi-gcc: No such file or directory
error: Setup script exited with error: command 'arm-none-linux-gnueabi-gcc' failed with exit status 1

It seems that easy_install had analized the egg, but it didn't regonize the result I had compiled, so it continued to download the source and tried to cross compile it, which of course would fail.

In fact, not only netifaces, I have try other extensions, psutil for example, the result is the same. I wonder which step I have go wrong?

Re: ASP.NET MVC and Ionic.Zip

Frédéric Delaporte — Fri, 15 May 2015 06:04:39 -0000

Hi,
5 years later, principles of inheriting ZipFileResult is still useful. But I would do some changes:
1 - replacing Ionic.Zip by fx 4.5 System.IO.Compression.ZipArchive. (Have not yet checked it works.) Ionic.Zip have a race condition bug causing file to get corrupted once compressed in some edge cases (see issue 14087 on its codeplex site), and it looks no more maintained.

2 - Rather than exposing "ZipFile" class outside of ZipFileResult (constructor argument), I would provide some poco argument for telling the zipFileResult where to find the bytes / file names / paths it has to put in the zip. This would avoid leaking of the zip lib outside of the ZipFileResult.

3 - Use MVC (5 but probably 3+) ZipFileResult headers handling (calling base constructor with contentType, setting FileDownloadName property, no more clearing and ending response, ...)

Regards.

Re: Cross Compiling Python Extensions

Sukhvinder Pal Singh — Mon, 20 Apr 2015 02:23:27 -0000

Cannot make it work! Help Please

I am using the default setup.py for a demo c module like below

from distutils.core import setup, Extension

module1 = Extension('demo',
sources = ['demo.c'])

setup (name = 'PackageName',
version = '1.0',
description = 'This is a demo package',
ext_modules = [module1])

I have exported the environment variable as suggested above to the android arm abi toolchain. I have also setup setuptools for android as suggested on the setup tools install instructions. The {PYTHONXCPREFIX}/lib contains python2.7 folder on the android toolchain I have, I have used this target python to run run the command python easy_install.py to setup the setuptools. But I am not sure how to build my demo module using disutilscross. Do I need to modify my setup.py?

Re: ASP.NET MVC and Ionic.Zip

Camille Ford — Tue, 03 Feb 2015 19:09:30 -0000

I also have a problem using this code like Jim. I just create a txt file to supplement the error given.

Buy Datpiff Downloads

Re: Notes on localization and jQueryUI Datepicker.

M. Korman — Wed, 11 Sep 2013 12:15:42 -0000

Excellent, thanks for the tip!

Only issue is that line 7 should read

retval = $.datepicker.regional[region[0]];

Re: HOWTO Cross Compile Python 2.5

AB — Sat, 30 Mar 2013 17:12:32 -0000

I want to cross-compile Python for a embedded system. The target is a PPC but DOES NOT run linux. Instead it runs a lesser known though capable embedded OS and I was wondering if anyone has attempted porting Python to a non-*nix platform before.

I have the cross compilation tool chain installed on a linux machine so I should be able to run the configure script pointing to the target OS/compiler headers and libraries. Also it seems that the Python configure script does not support options such
as –with-headers, –with-binutils that would allow me to point it to the
correct headers.

Has anybody done a port like this?

Re: GNU Make, win32 and sed

Michael Field — Thu, 15 Nov 2012 05:14:03 -0000

Ok. I found the solution that works in both versions.

Using two backslashes should be ok.
But to fix MSYS version, you have to enter \x5c\x5c.
Similarly, for double quotes, I use \x22.

And, this of course works in every other sed.

Re: GNU Make, win32 and sed

Michael Field — Thu, 15 Nov 2012 05:03:42 -0000

Wow. This was long ago.
But, the problem still exists. I know, because I just encountered it.

Any solution for unifying whose two (GnuWin sed and MSYS sed)?
I not sure ever which one gets called (usually MSYS version from Git for Windows).

Thanks anyway. Now I know I'm not the only one.

Re: ASP.NET MVC and Ionic.Zip

Jim — Mon, 11 Jun 2012 17:03:17 -0000

using your exact example.. I get an error at the zip.AddEntry line of code. There is no matching overload method. A better example for this would be adding a zip file from a file already in your database and or creating a txt file grammatically and then adding it to the zip file for the user to download.

Re: Cross Compiling Python Extensions

Yegor Yefremov — Tue, 08 May 2012 14:07:33 -0000

Chris,

do you have an idea, how to solve this issue: https://groups.google.com/d...

Thanks

Re: Cross Compiling Python Extensions

Yegor Yefremov — Tue, 03 Jan 2012 12:08:16 -0000

Chris: are you going to provide your slides for PyCon before the event itself?

Re: Cross Compiling Python Extensions

Yegor Yefremov — Thu, 29 Dec 2011 14:19:00 -0000

I've got it!!!

The first problem with checks was, that setup.py while checking for headers has also tried to execute the binary. That was not so good to execute arm binary on x86 ;-)

The second is trickier as it concerns library paths. During linking the only -L option I see is -L/usr/lib despite specifying LDFLAGS. This output of the linker_so at the biginning of setup.py:

Linker_so: ['/home/user/Documents/projects/br-queue-python/output/host/usr/bin/arm-none-linux-gnueabi-gcc', '-shared', '-L/home/user/Documents/projects/br-queue-python/output/host/usr/arm-unknown-linux-gnueabi/sysroot/lib', '-L/home/user/Documents/projects/br-queue-python/output/host/usr/arm-unknown-linux-gnueabi/sysroot/usr/lib']

at the end I solved this by providing library_dirs myself. Any idea?

I wish you good luck for your PyCon talk. And I hope Python devs will understand the difference between compilation and cross-compilation. And some common framework linke autotools should be also available, so there is no need to write own checks.

Thanks for helping. Happy New Year!

Re: Cross Compiling Python Extensions

Yegor Yefremov — Thu, 29 Dec 2011 08:49:45 -0000

No. That didn't help.

define PYTHON_NETIFACES_BUILD_CMDS
(cd $(@D); \
CC="$(TARGET_CC)" \
CFLAGS="$(TARGET_CFLAGS)" \
PYTHONXCPREFIX="$(HOST_DIR)/usr/" \
LDSHARED="$(TARGET_CC) -shared" \
LDFLAGS="-L$(HOST_DIR)/lib -L$(HOST_DIR)/usr/lib" \
$(HOST_DIR)/usr/bin/python setup.py build -x)
endef

Build result:

python-netifaces 0.6 Building
(cd /home/user/Documents/projects/br-queue-python/output/build/python-netifaces-0.6; CC="/home/user/Documents/projects/br-queue-python/output/host/usr/bin/arm-none-linux-gnueabi-gcc" CFLAGS="-pipe -Os -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64" PYTHONXCPREFIX="/home/user/Documents/projects/br-queue-python/output/host/usr/" LDSHARED="/home/user/Documents/projects/br-queue-python/output/host/usr/bin/arm-none-linux-gnueabi-gcc -shared" LDFLAGS="-L/home/user/Documents/projects/br-queue-python/output/host/lib -L/home/user/Documents/projects/br-queue-python/output/host/usr/lib" /home/user/Documents/projects/br-queue-python/output/host/usr/bin/python setup.py build -x)
running build
Setting prefix
Setting prefix
running build_ext
checking for getifaddrs... not found. (cached)
checking for getnameinfo... not found. (cached)
checking for socket IOCTLs... not found. (cached)
checking for optional header files... netash/ash.h netatalk/at.h netax25/ax25.h neteconet/ec.h netipx/ipx.h netpacket/packet.h linux/irda.h linux/atm.h linux/llc.h linux/tipc.h linux/dn.h. (cached)
checking whether struct sockaddr has a length field... no. (cached)
checking which sockaddr_xxx structs are defined... at ax25 in in6 ipx un ash ec ll atmpvc atmsvc dn irda llc. (cached)
building 'netifaces' extension
/home/user/Documents/projects/br-queue-python/output/host/usr/bin/arm-none-linux-gnueabi-gcc -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -pipe -Os -D_LARGEFILE_SOURCE -D_LARGEFILE64_SOURCE -D_FILE_OFFSET_BITS=64 -fPIC -DHAVE_NETASH_ASH_H=1 -DHAVE_NETATALK_AT_H=1 -DHAVE_NETAX25_AX25_H=1 -DHAVE_NETECONET_EC_H=1 -DHAVE_NETIPX_IPX_H=1 -DHAVE_NETPACKET_PACKET_H=1 -DHAVE_LINUX_IRDA_H=1 -DHAVE_LINUX_ATM_H=1 -DHAVE_LINUX_LLC_H=1 -DHAVE_LINUX_TIPC_H=1 -DHAVE_LINUX_DN_H=1 -DHAVE_SOCKADDR_AT=1 -DHAVE_SOCKADDR_AX25=1 -DHAVE_SOCKADDR_IN=1 -DHAVE_SOCKADDR_IN6=1 -DHAVE_SOCKADDR_IPX=1 -DHAVE_SOCKADDR_UN=1 -DHAVE_SOCKADDR_ASH=1 -DHAVE_SOCKADDR_EC=1 -DHAVE_SOCKADDR_LL=1 -DHAVE_SOCKADDR_ATMPVC=1 -DHAVE_SOCKADDR_ATMSVC=1 -DHAVE_SOCKADDR_DN=1 -DHAVE_SOCKADDR_IRDA=1 -DHAVE_SOCKADDR_LLC=1 -I/home/user/Documents/projects/br-queue-python/output/host/usr/include/python2.7 -c netifaces.c -o build/temp.linux-i686-2.7/netifaces.o
netifaces.c:143:6: error: #error You need to add code for your platform.
netifaces.c:268:1: warning: 'string_from_sockaddr' defined but not used
netifaces.c:360:1: warning: 'add_to_family' defined but not used
error: command '/home/user/Documents/projects/br-queue-python/output/host/usr/bin/arm-none-linux-gnueabi-gcc' failed with exit status 1

I have such a premonition, that CC won't be honored. For the test I just renamed the gcc binary and build_ext was not complaining during the test. The only thing that failed was netifaces.c compilation, because of absent compiler binary.

The test_build method in netifaces setup.py has tree return possibilities:
- no error
- CompileError
- DistutilsExecError

But since the return value is boolean I don't know which part failed. Print is not visible in this method. Will have to dig deeper.

Re: Cross Compiling Python Extensions

Christopher Lambacher — Wed, 28 Dec 2011 21:10:02 -0000

Yegor: It looks like you are missing -L options in your LDFLAGS. It should be LDFLAGS="-L$(HOST_DIR)/lib/ -L$(HOST_DIR)/usr/lib/".

Re: Cross Compiling Python Extensions

Yegor Yefremov — Wed, 28 Dec 2011 08:14:01 -0000

Hi Chris,

I've a problem cross-compiling netifaces from Alastair Houghton for ARM using Buildroot. I've installed distutilscross and specified all needed environment variables, but setuptools 0.6c11 doesn't seem to be interested in specified CC. The -x option will be recognized, but all netifaces tests fail:

running build
Setting prefix
Setting prefix
running build_ext
checking for getifaddrs... not found. (cached)
checking for getnameinfo... not found. (cached)
checking for socket IOCTLs... not found. (cached)

That is how I configure netifaces for cross-compiling:

define PYTHON_NETIFACES_BUILD_CMDS
(cd $(@D);\
CC="$(TARGET_CC) -pthread" \
LDSHARED="$(TARGET_CC) -pthread -shared" \
PYTHONXCPREFIX="$(HOST_DIR)/usr/" \
LDFLAGS="$(HOST_DIR)/lib/ $(HOST_DIR)/usr/lib/" \
$(HOST_DIR)/usr/bin/python setup.py build -x)
endef

Do you have any idea?

Thank you in advance and merry Xmas and Happy New Year!

P.S. such statement as --plat-name=linux-arm will be not recognized

Re: Cross Compiling Python Extensions

James Le Cuirot — Wed, 28 Dec 2011 00:14:55 -0000

Hi Chris. Sorry again for the noise but I've just made an important discovery. Whilst patching this feature into Python directly, I wondered where the default values for PREFIX and EXEC_PREFIX come from. It turns out you can already override these by setting the PYTHONHOME environment variable. The catch is that all the Python stuff you need to complete the build (e.g. setuptools) needs to be installed in the prefix as the only files it touches from the host are the native Python executable and library. If the build needs to execute any native Python extensions then this probably won't work but I doubt any Python build system does this. In the Gentoo case, it will automatically install prerequisites like setuptools for you. I'll play with this more tomorrow.

Re: Cross Compiling Python Extensions

Christopher Lambacher — Mon, 26 Dec 2011 22:07:32 -0000

I'll be doing a talk on this stuff at PyCon 2012: https://us.pycon.org/2012/s...

Re: Cross Compiling Python Extensions

Christopher Lambacher — Mon, 26 Dec 2011 22:06:36 -0000

Hi James, setuptools is required for distutils. You should be able to get non-setuptools packages to work using:

python -c "import setuptools; execfile('setup.py')" -x build

You can substitute any other command for build as you require (including bdist_egg).

Re: Cross Compiling Python Extensions

James Le Cuirot — Mon, 26 Dec 2011 21:07:17 -0000

Ah it works if the package imports setuptools instead of distutils. I was trying it with rdiff-backup, which imports distutils. I gather entry points are specific to setuptools. Is there any way to make it magically work in this situation?

Re: Cross Compiling Python Extensions

James Le Cuirot — Mon, 26 Dec 2011 15:08:46 -0000

Does this still work for you? I've tried it on Gentoo (Python 2.6 and 2.7) and Ubuntu (Python 2.6) and it doesn't load automatically as the -x option is missing. I've filled an issue at https://bitbucket.org/lamba... but it's been a long time since there were any commits.

Re: HOWTO Cross Compile Python 2.5

fran — Thu, 18 Aug 2011 08:06:14 -0000

How I could cross-compile PyBluez module for ARM platform? Any hints?

Thanks.

Re: Cross Compiling Python Extensions

fran — Wed, 03 Aug 2011 10:06:54 -0000

How I could cross-compile PyBluez module for ARM platform? I've been searching information on Internet but I haven't found anything.

Thanks in advance.

Re: HOWTO Cross Compile Python 2.5

Christopher Lambacher — Wed, 02 Mar 2011 19:53:50 -0000

@Mahendra you might want to look at http://whatschrisdoing.com/... which makes the process simpler.

Re: HOWTO Cross Compile Python 2.5

Mahendra — Tue, 01 Mar 2011 09:28:09 -0000

Hello Chris,

I already have Python 2.6 cross compiled for ARM. However, now I am trying to cross compile "Python Image Library" and getting stuck with the same.

Do you have any idea as to how can I cross-compile PIL. Can you help me?

Thanking in anticipation.

Re: Protecting Plone Registration Forms with ReCAPTCHA

Christopher Lambacher — Thu, 23 Sep 2010 13:43:05 -0000

Hi Sam,

I am not sure I understand what you mean about the form validation for contact-info. It's been a while since I did it, but all the info you need to implement captcha is contained in here. You will need to look at other documentation for anything else.

-Chris